Many Deaf people use their mobile phones for communication yet they would prefer to converse in South African Sign Language. Deaf people with a capital 'D' is different from deaf or hard of hearing as they primarily use sign language to communicate. This study explores how to implement a Deaf-to-hearing communication aid on a mobile phone to support a Deaf person's visit to a medical doctor. The aim is to help a Deaf person use sign language to tell a hearing doctor in English about medical problems using a cell phone. A preliminary trial of a computer-based mock-up indicated that Deaf users would like to see the prototype on a cell phone. A prototype will be built for a mobile phone browser using sign language video arranged in an organized way to identify a medical problem. That problem is then identified in English and shown to the doctor with the phone. User trials data will be collected with questionnaires, semi-structured interviews and video recordings. The technical goal is to implement the prototype on a mobile device in a context free manner, allowing the plug and play of more communication scenarios, such as visits to Home Affairs or the police station.