Komatsu selects NVIDIA as partner for deploying AI to create safer, more efficient construction sites

Related Articles

• Comansa announces upcoming large Flat-Top tower crane in Bauma
• Raimondi MRT294 flat-top tower cranes participate in the build of a suspension bridge in Romania
• Komatsu and Proterra announce new collaboration to develop all-electric construction equipment

Komatsu has selected NVIDIA as its partner to bring AI (Artificial Intelligence) to jobsites, making them safer and more efficient. The partnership will focus on Komatsu using NVIDIA GPUs to visualize and analyze entire construction sites. The NVIDIA Jetson AI platform will serve as the brain of heavy machinery deployed on these sites, enabling improved safety and productivity.

“Artificial intelligence is sweeping across industries, and its next frontier is autonomous intelligent machines,” said NVIDIA founder and CEO Jensen Huang. “Future machines will perceive their surroundings and be continuously alert, helping operators work more efficiently and safely. The construction and mining industries will benefit greatly from these advances.”

Construction is the latest in a series of industries in which NVIDIA has signed agreements with market leaders to help revolutionize how they operate. Among these are partnerships with GE Healthcare and Nuance in the area of medical imaging; FANUC in the field of robotics; and more than 225 car makers, startups and research houses – among them, Audi, Tesla, Toyota and Volvo – for autonomous driving.

Construction industry primed for AI’s benefits
Safety risks and inefficiencies in the construction industry make it particularly well suited for improvements powered by AI. Construction sites are generally considered among the more dangerous workplaces because of the presence of heavy equipment, uneven terrain and continuous activity.

AI to augment Komatsu’s “SMARTCONSTRUCTION” initiative
To help address these issues, Komatsu began in 2015 rolling out its “SMARTCONSTRUCTION” initiative, connecting data related to onsite workers and objects to make worksites safer and more productive. The initiative has been introduced in more than 4,000 sites across the country, with plans to expand both domestically and internationally.

Extending the SMARTCONSTRUCTION initiative, Komatsu will use NVIDIA technology to create 3D visualizations of construction sites, showing the real-time interaction of people, machinery and objects. Costly onsite equipment can be closely monitored to ensure it is used with optimal efficiency.

NVIDIA GPUs will communicate with drones and cameras in the construction sites, acting as an AI platform for analysis and visualization. SkyCatch will provide drones to gather and map 3D images for visualizing the terrain at the edge. OPTiM, an IoT management-software company, will provide an application to identify individuals and machinery collected from surveillance cameras. Both of these Komatsu partners are also members of NVIDIA’s Inception program for AI startups.

At the center of the collaboration is NVIDIA Jetson, a credit-card sized platform that delivers AI computing at the edge. Working in tandem with NVIDIA cloud technology, Jetson will power cameras mounted on Komatsu’s construction equipment and enable 360-degree views to readily identify people and machines nearby to prevent collisions and other accidents. Jetson will also be used in stereo cameras located in the cabs of construction machines to help assess rapidly changing conditions in real time and instruct the driver accordingly. Future applications include high-resolution rendering and virtual simulations of construction and mining sites along with automated control of machinery.