A literate and numerate population is the goal of any modern industrialized society. Literacy and mathematics skills carry the means by which children are equipped for the education processes on which their future will depend. Deaf and hard of hearing students' reading and mathematics skills are lower than that of others due to their inability. Before enhancing their literacy and mathematics skills, their standard of literacy and mathematics skills should first be identified. For this reason, the Malaysian Ministry of Education initiated the Literacy and Numeracy Screening (LINUS) program in 2009. However, problems arose in the assessment method of LINUS screening for these students since the LINUS screening method does not accommodate these students' situation and needs. Therefore, the researchers introduced internet-based Literacy and Mathematics Assessment (iLiMA) prototype that can overcome those problems. In the iLiMA prototype, sign language instruction video is used to standardize the assessment method in order to ensure that non-bias assessment could be established. The methodology used to develop this system is the Evolutionary Process Model - Prototype. The iLiMA prototype usability was assessed with the Computer System Usability Questionnaire (CSUQ) and conducted by using web-based survey method. The results indicate that the iLiMA prototype is usable and teachers are satisfied with it. Finally, the iLiMA prototype which had the potential to accommodate deaf and hard of hearing students to get a standardized and non-bias literacy and mathematics assessment was developed.