This paper introduces a research example in the Social Cooperation Program “Intelligent Construc- tion System” organized by the University of Tokyo and Fujita Corporation. This includes trafficability judgement of construction machines at landslide disaster sites, tumble avoidance of construction machines while driving, and generate free viewpoint images when working with multiple construction machines for disaster response. In addition, this includes action recognition of construction machine to quantitatively assess work efficiency for general earthwork.