- Lens Parameters: such as the instruction and focus of the lens
- Lens Data Streams: such as what sensors should be connected to a lens and where the lens output should be streamed.
What You Can Configure
Instruction and Focus
Theinstruction and focus parameters in lens_parameters tell Newton what to look for and how to respond. These are analogous to system prompts in traditional LLMs, but are specifically designed for physical-world reasoning tasks.
- Be specific about the output format you expect
- Provide context about the sensor placement or environment (e.g., “this camera is on 104th and main street looking west-to-east”)
- Clearly define what constitutes an alert or event worth reporting
Input and Output Streams
Configure how data flows into and out of the lens: Each lens can be customized to read and write from dedicated data streams. For example, a developer can stream data from a CSV file or video file into a lens and then stream the results back to an external application via a Server Sent Events stream. Available stream types are documented in the Streams section. The example below demonstrates how a CSV file can be hooked up and streamed into a lens.Lens-Specific Parameters
Different lenses expose different configuration options. Common parameters include:
Refer to the documentation for your specific lens to see all available parameters.
When to Use Lens Customization
Lens customization is appropriate when:- You’re getting started and want to quickly test different configurations.
- You want to change what Newton focuses on for your specific use case, such as real-time safety alerts in a factory.
- Your use case or sensor data does not require extensive customization.