Abstract: Assessment and testing of skills achieve during a course is a prime requirement of the educators. Out of the many teaching and training programs, prime attention goes to ICT teaching programs which have gained an unprecedented demand in all levels of educational institutes today. Assessment of computer related skills are done in several different modes. However, the authors believe that the ideal testing mechanism must provide the students with the facility of using a computer rather than answering on their memory of using a computer. The testing mechanism described herein was designed and implemented at the main ICT training facility in the University of Peradeniya, the Information Technology Center (IT Center), in order to address this need and also to facilitate conducting tests amidst numerous technical and logistical challenges. The comparative analysis shows that the hybrid test system which involves students answering a printed MCQ type paper while attempting the relevant software based tasks on a computer is capable of delivering higher testable course outcomes as well as topics under cash category. The same can be easily improved to be a fully computer based test depending on the ability of the skills of beginners in handling a computer for multiple tasks.