In order to meet the enterprise requirements of qualification test for new vehicles， an automatic testing system of vehicle driving-wandering based on vehicle image sensor is presented. Based on platform of Matlab image processing， image reprocessing， lane edge detection and lane fitting are carried out respectively， and the position coordinates of lane feature points are extracted. According to the coordinate transformation relationship and offtracking model， the deviation amount of the target vehicle in test area is determined. Practical application shows that the system is easy to install and debug， with high degree of automation， high measurement accuracy， strong real-time， and also meets the requirements of modularization， convenient integration， smooth system operation， which can meet the requirements of enterprise testing.