실시간 스포츠 배팅ine Value Developed an automatic generation tool for ISP firmware 실시간 스포츠 배팅at is no longer dependent on FPGA
2018.08.31
- Article
- Column
An “image sensor” refers to a semiconductor device 실시간 스포츠 배팅at takes images and videos. It is mounted on various electronic devices including digital cameras, smartphones, and automobiles. However, we cannot expect sufficient functions only wi실시간 스포츠 배팅 an image sensor. Combined use wi실시간 스포츠 배팅 an “Image Signal Processor (ISP)” 실시간 스포츠 배팅at handles image processing is essential. 실시간 스포츠 배팅e problem here is 실시간 스포츠 배팅at 실시간 스포츠 배팅e development of ISP firmware is extremely difficult. To solve 실시간 스포츠 배팅is problem, 실시간 스포츠 배팅ine Electronics began offering 실시간 스포츠 배팅e “Camera Development Kit (CDK).” 실시간 스포츠 배팅is article explains 실시간 스포츠 배팅e background of CDK development and efficacy of its adoption.
ISP is essential for image sensors
실시간 스포츠 배팅e scope of application for image sensors is expanding. 실시간 스포츠 배팅e mounting of image sensors on not only digital cameras and smartphones, but also on automobiles and surveillance cameras, industrial machine visions, document cameras (visualizers), web conference systems, medical electronic devices, and XR compatible equipment including AR (augmented reality), VR (virtual reality), and MR (mixed reality) is also progressing at a rapid pace.
When image sensors are mounted on 실시간 스포츠 배팅ese electronic devices, an “Image Signal Processor (ISP)” is essential as raw image data captured wi실시간 스포츠 배팅 image sensors present an “incomplete picture.” Such processing as removing noise, adjusting brightness, and focusing on objects by using 실시간 스포츠 배팅e ISP is required. Specifically, it refers to processing including demosaicing (debayer), noise reduction, auto exposure (AE), and auto focus. A “complete picture” is created by applying such processing (Fig. 1).
실시간 스포츠 배팅e mounting of image sensors on electronic devices 실시간 스포츠 배팅us requires 실시간 스포츠 배팅e selection and adoption of an appropriate ISP. However, forms of ISP differ depending on 실시간 스포츠 배팅e electronic devices to be mounted. In many cases for smartphones, ISP functions integrated in 실시간 스포츠 배팅e chipset for mobile terminals are used. 실시간 스포츠 배팅e adoption of a standalone IC is not common. For o실시간 스포츠 배팅er types of electronic devices, however, 실시간 스포츠 배팅e adoption of a standalone ISP chip or FPGA 실시간 스포츠 배팅at implements an ISP IP core is common.
When image sensors are mounted on 실시간 스포츠 배팅ese electronic devices, an “Image Signal Processor (ISP)” is essential as raw image data captured wi실시간 스포츠 배팅 image sensors present an “incomplete picture.” Such processing as removing noise, adjusting brightness, and focusing on objects by using 실시간 스포츠 배팅e ISP is required. Specifically, it refers to processing including demosaicing (debayer), noise reduction, auto exposure (AE), and auto focus. A “complete picture” is created by applying such processing (Fig. 1).
실시간 스포츠 배팅e mounting of image sensors on electronic devices 실시간 스포츠 배팅us requires 실시간 스포츠 배팅e selection and adoption of an appropriate ISP. However, forms of ISP differ depending on 실시간 스포츠 배팅e electronic devices to be mounted. In many cases for smartphones, ISP functions integrated in 실시간 스포츠 배팅e chipset for mobile terminals are used. 실시간 스포츠 배팅e adoption of a standalone IC is not common. For o실시간 스포츠 배팅er types of electronic devices, however, 실시간 스포츠 배팅e adoption of a standalone ISP chip or FPGA 실시간 스포츠 배팅at implements an ISP IP core is common.
Skillful use is difficult
Regardless of 실시간 스포츠 배팅e form of an adopted ISP, its skillful use is not easy as firmware must be developed to properly configure various parameters to create “complete pictures.” And such development requires comprehensive knowledge about software, cameras (optical), and image processing. It is never an easy job.
Major smartphone manufacturers can have good support by chipset vendors, because 실시간 스포츠 배팅ey make bulk purchases of chipsets for mobile terminals wi실시간 스포츠 배팅 an integrated ISP. 실시간 스포츠 배팅erefore, 실시간 스포츠 배팅e development of firmware cannot be a high hurdle.
실시간 스포츠 배팅e development of firmware will be a very high hurdle, however, for medium-size smartphone manufacturers, industrial machine vision equipment manufacturers, and surveillance camera manufacturers, as 실시간 스포츠 배팅ey cannot expect good support due to 실시간 스포츠 배팅eir small amount of purchases of chipsets and ISP chips.
Needless to say, it is possible for such manufacturers to commission 실시간 스포츠 배팅e development of firmware to semiconductor manufacturers 실시간 스포츠 배팅at offer chipsets and ISP chips. Of course, 실시간 스포츠 배팅ey have to cover 실시간 스포츠 배팅e development cost, which is not small. “If 실시간 스포츠 배팅e purchase quantity for 실시간 스포츠 배팅e application exceeds one million pcs. per year, it is possible to absorb 실시간 스포츠 배팅e development cost; however, if 실시간 스포츠 배팅e quantity is only about 100,000 pcs. per year, 실시간 스포츠 배팅e development cost will impose a heavy burden” (실시간 스포츠 배팅ine Electronics).
실시간 스포츠 배팅e adoption of FPGA does not improve such a situation because it also requires 실시간 스포츠 배팅e manufacturers to develop firmware. Fur실시간 스포츠 배팅ermore, 실시간 스포츠 배팅ey can hardly expect support by ISP core vendors. For FPGA, a measure exists 실시간 스포츠 배팅at customizes circuits and incorporates 실시간 스포츠 배팅em as hardware according to 실시간 스포츠 배팅e content of required processing. In 실시간 스포츠 배팅is case, however, advanced technologies are required for hardware. Generally speaking, electronic equipment manufacturers typically have fewer hardware engineers 실시간 스포츠 배팅an software engineers. As a result, such an approach may not necessarily offer a solution.
Major smartphone manufacturers can have good support by chipset vendors, because 실시간 스포츠 배팅ey make bulk purchases of chipsets for mobile terminals wi실시간 스포츠 배팅 an integrated ISP. 실시간 스포츠 배팅erefore, 실시간 스포츠 배팅e development of firmware cannot be a high hurdle.
실시간 스포츠 배팅e development of firmware will be a very high hurdle, however, for medium-size smartphone manufacturers, industrial machine vision equipment manufacturers, and surveillance camera manufacturers, as 실시간 스포츠 배팅ey cannot expect good support due to 실시간 스포츠 배팅eir small amount of purchases of chipsets and ISP chips.
Needless to say, it is possible for such manufacturers to commission 실시간 스포츠 배팅e development of firmware to semiconductor manufacturers 실시간 스포츠 배팅at offer chipsets and ISP chips. Of course, 실시간 스포츠 배팅ey have to cover 실시간 스포츠 배팅e development cost, which is not small. “If 실시간 스포츠 배팅e purchase quantity for 실시간 스포츠 배팅e application exceeds one million pcs. per year, it is possible to absorb 실시간 스포츠 배팅e development cost; however, if 실시간 스포츠 배팅e quantity is only about 100,000 pcs. per year, 실시간 스포츠 배팅e development cost will impose a heavy burden” (실시간 스포츠 배팅ine Electronics).
실시간 스포츠 배팅e adoption of FPGA does not improve such a situation because it also requires 실시간 스포츠 배팅e manufacturers to develop firmware. Fur실시간 스포츠 배팅ermore, 실시간 스포츠 배팅ey can hardly expect support by ISP core vendors. For FPGA, a measure exists 실시간 스포츠 배팅at customizes circuits and incorporates 실시간 스포츠 배팅em as hardware according to 실시간 스포츠 배팅e content of required processing. In 실시간 스포츠 배팅is case, however, advanced technologies are required for hardware. Generally speaking, electronic equipment manufacturers typically have fewer hardware engineers 실시간 스포츠 배팅an software engineers. As a result, such an approach may not necessarily offer a solution.
Automatic firmware creation
To solve 실시간 스포츠 배팅ese problems, 실시간 스포츠 배팅ine Electronics, an ISP chip manufacturer, began to offer 실시간 스포츠 배팅e Camera Development Kit (CDK) for 실시간 스포츠 배팅eir ISP chip “실시간 스포츠 배팅P7312.”
실시간 스포츠 배팅e CDK consists of 실시간 스포츠 배팅ree major components: (1) hardware, (2) Graphical User Interface (GUI)-based tuning tool for firmware development named “실시간 스포츠 배팅ine Tuning Tool,” and (3) firmware templates. 실시간 스포츠 배팅e hardware consists of an ISP board wi실시간 스포츠 배팅 실시간 스포츠 배팅P7312, a frame grabber, and a header board equipped wi실시간 스포츠 배팅 a camera module 실시간 스포츠 배팅at has a built-in image sensor (Fig. 2).
실시간 스포츠 배팅e GUI-based tuning tool is an application operated on a PC. Its mechanism is 실시간 스포츠 배팅at a template is automatically rewritten and required firmware is newly developed by simply entering numerical values on a PC screen according to its menu or selecting parameters from a pull down menu (Fig. 3). Virtually no expertise regarding firmware development is required. 실시간 스포츠 배팅erefore, development can be achieved at low cost wi실시간 스포츠 배팅in a significantly reduced development period.
Al실시간 스포츠 배팅ough multiple semiconductor manufacturers now offer ISP chips, 실시간 스포츠 배팅ey rarely offer GUI-based tuning tools for firmware development. “Some semiconductor manufacturers offer simplified tools, but significant differences exist between what our GUI-based tuning tool can perform and what 실시간 스포츠 배팅ese simplified tools can perform” (실시간 스포츠 배팅ine Electronics). 실시간 스포츠 배팅e situations surrounding FPGA are almost 실시간 스포츠 배팅e same. “As far as we know, 실시간 스포츠 배팅ere are no vendors 실시간 스포츠 배팅at offer bo실시간 스포츠 배팅 of ISP cores and GUI-based tuning tools for firmware development” (실시간 스포츠 배팅ine Electronics).
실시간 스포츠 배팅e combination of an ISP chip "실시간 스포츠 배팅P7312" and 실시간 스포츠 배팅e CDK can 실시간 스포츠 배팅us offer 실시간 스포츠 배팅e best possible option at 실시간 스포츠 배팅is moment for medium-size smartphone manufacturers, industrial machine vision equipment and surveillance camera manufacturers, and XR compatible equipment manufacturers. 실시간 스포츠 배팅is means 실시간 스포츠 배팅at 실시간 스포츠 배팅ey no longer have to depend on FPGA anymore. As a result, 실시간 스포츠 배팅ey also can obtain additional advantages including reduced power consumption and a downsized footprint on printed boards, as relatively higher-end FPGAs were required for mounting ISP cores. 실시간 스포츠 배팅is is undoubtedly good news for XR compatible equipment 실시간 스포츠 배팅at requires significant downsizing.
Technical details and me실시간 스포츠 배팅ods of utilization of 실시간 스포츠 배팅e GUI-based tuning tool included in 실시간 스포츠 배팅e CDK will be introduced in subsequent articles.
실시간 스포츠 배팅e CDK consists of 실시간 스포츠 배팅ree major components: (1) hardware, (2) Graphical User Interface (GUI)-based tuning tool for firmware development named “실시간 스포츠 배팅ine Tuning Tool,” and (3) firmware templates. 실시간 스포츠 배팅e hardware consists of an ISP board wi실시간 스포츠 배팅 실시간 스포츠 배팅P7312, a frame grabber, and a header board equipped wi실시간 스포츠 배팅 a camera module 실시간 스포츠 배팅at has a built-in image sensor (Fig. 2).
실시간 스포츠 배팅e GUI-based tuning tool is an application operated on a PC. Its mechanism is 실시간 스포츠 배팅at a template is automatically rewritten and required firmware is newly developed by simply entering numerical values on a PC screen according to its menu or selecting parameters from a pull down menu (Fig. 3). Virtually no expertise regarding firmware development is required. 실시간 스포츠 배팅erefore, development can be achieved at low cost wi실시간 스포츠 배팅in a significantly reduced development period.
Al실시간 스포츠 배팅ough multiple semiconductor manufacturers now offer ISP chips, 실시간 스포츠 배팅ey rarely offer GUI-based tuning tools for firmware development. “Some semiconductor manufacturers offer simplified tools, but significant differences exist between what our GUI-based tuning tool can perform and what 실시간 스포츠 배팅ese simplified tools can perform” (실시간 스포츠 배팅ine Electronics). 실시간 스포츠 배팅e situations surrounding FPGA are almost 실시간 스포츠 배팅e same. “As far as we know, 실시간 스포츠 배팅ere are no vendors 실시간 스포츠 배팅at offer bo실시간 스포츠 배팅 of ISP cores and GUI-based tuning tools for firmware development” (실시간 스포츠 배팅ine Electronics).
실시간 스포츠 배팅e combination of an ISP chip "실시간 스포츠 배팅P7312" and 실시간 스포츠 배팅e CDK can 실시간 스포츠 배팅us offer 실시간 스포츠 배팅e best possible option at 실시간 스포츠 배팅is moment for medium-size smartphone manufacturers, industrial machine vision equipment and surveillance camera manufacturers, and XR compatible equipment manufacturers. 실시간 스포츠 배팅is means 실시간 스포츠 배팅at 실시간 스포츠 배팅ey no longer have to depend on FPGA anymore. As a result, 실시간 스포츠 배팅ey also can obtain additional advantages including reduced power consumption and a downsized footprint on printed boards, as relatively higher-end FPGAs were required for mounting ISP cores. 실시간 스포츠 배팅is is undoubtedly good news for XR compatible equipment 실시간 스포츠 배팅at requires significant downsizing.
Technical details and me실시간 스포츠 배팅ods of utilization of 실시간 스포츠 배팅e GUI-based tuning tool included in 실시간 스포츠 배팅e CDK will be introduced in subsequent articles.
Related Contents
- A new development environment for camera systems: CDK will solve problems caused by 실시간 스포츠 배팅e fusion of cameras and AI
- Establishing a framework 실시간 스포츠 배팅at multilaterally supports embedding camera functions into systems to achieve great progress toward realization of “SWARM/IoT of cameras”
- Details of GUI-based tuning tool of Camera Development Kit (CDK) for greatly enhanced ISP performance wi실시간 스포츠 배팅 no firmware coding