There has been a shortfall in the number of nurses, so it is required to optimize the nursing service. Then, the authors proposed a new system design for automated time study of nursing to investigate nursing service easily. The system combines images from video monitoring and information from ambient sensing, and it analyzes them after combining. Besides the authors conducted video monitoring with ambient sensing in a hospital and analyzed images from the video monitoring. The authors indicated the effectiveness and potential of the system.