Besides primary driving task, we used to have additional actions, for example, operating some buttons and looking for something. Such secondary actions have been the major cause of accidents. Using a driving simulator the effect of the physical workloads on driving performance was examined for two traffic situations. From the experimental results, the driving performance was influenced by the body movements caused by the physical workloads and the effects were verified by computational driving model in the case of the emergency avoidance.