Abstract: During recent disasters such as tsunami, flooding, hurricanes, nuclear disaster, earthquake people have to leave their living areas for their own safety. But it proves that some people are not informed about the evacuation, or are not willing or able to leave or don't know how to leave the hazardous areas. The topic of the paper is how to adapt current video surveillance systems along highway and streets to semi-automatic surveillance systems. When a suspicious event is detected a human operator in the control room has to be alerted to take appropriate actions. The architecture of the system and main modules are presented in the paper. Different algorithms to detect localize and track people are published by the authors elsewhere but are summarized in the current paper. The system has been tested in a real life environment and the test results are presented in the paper.