Empowering HITers for Melanoma annotation tasks: Training and Selection Process
Elevating Data Annotation: The different steps of the isahit recruitment and training process
Precision and expertise are necessary to reach 100% quality in data annotation. The process of selecting images annotators, called HITers at isahit, for projects like iToBoS involves rigorous criteria to ensure the highest quality in final annotations.
At isahit, the selection process relies on multiple factors, including a medical educational background and technical proficiency on labeling images.
- Educational Background: HITers are selected based on their educational qualifications, which helps them understand medical and technical aspects needed for melanoma annotation. Annotators with backgrounds in medical sciences or related fields are recruited in priority on the project due to their familiarity with medical terminology and concepts.
- Technical Skills: Alongside their educational background, technical skills play a crucial role in the isahit selection process. HITers take tests on the isahit platform to evaluate their proficiency in utilizing annotation tools like V7 and understanding the project requirements needed for iToBoS. These tests and assessments, coupled with their achievements on our proprietary isahit digital academy, determine the level of qualification of HITers for melanoma annotation tasks.
The Training Path beyond Melanoma Annotation Proficiency
Once being selected, HITers follow a training path tailored to provide them the necessary skills for melanoma annotation. The training is built from a variety of tools and methods aimed at increasing labellers annotation proficiency:
- Educational Resources: HITers receive educational content and materials selected by isahit that provide detailed information on melanoma identification and annotation guidelines. These resources, vetted by iToBoS clinicians, cover essential topics such as lesion categorization and identification of sun damage levels.
- Practical Exercises: Practical training exercises are a crucial component of our training process. HITers engage in hands-on exercises they do on the in-house isahit labeling tool, familiarizing themselves with the specificities of melanoma labeling and image annotation tools. These exercises simulate real-world annotation scenarios.
- Dedicated Training Videos: HITers have access to training videos developed by isahit, covering topics like the utilization of the V7 labeling tool or and an exhaustive explanation of the different labels and classes relevant to melanoma annotation. These videos are extremely helpful resources that assist HITers in discovering and then mastering the annotation process.
The Testing phase and continuous Learning from the annotators
Maintaining the quality of annotations requires making sure that HITers continually improve their expertise. To achieve this, a solid testing process and continuous learning programs are implemented.
- Testing Process: HITers go through a testing phase during which they annotate a small number of images under the supervision of a project manager. These annotated images are meticulously reviewed by a second annotator, ensuring accuracy to annotation guidelines. Images requiring revision are returned to the queue for a second annotation, ensuring that only high-quality annotations proceed to the final phase.
- Continuous Learning Initiatives: Continuous learning exists through ongoing training sessions and initiatives aimed at enhancing annotation skills. HITers receive regular feedback from their project managers, enabling them to refine their annotation techniques. Additionally, a percentage of annotated images are reviewed by clinicians from the iToBoS project, providing valuable insights and fostering improvement in the continuous work of HITers.
Continuously supporting Annotators in their labeling work.
At isahit, a culture of continuous support is implemented in the annotation process to empower HITers and improve their labeling skills and efficiency.
- Dedicated Project Manager: Each project is controlled by a dedicated project manager who serves as a point of contact for the HITers. The project manager provides guidance, answers queries, and offers instructions to ensure seamless workflow and address any challenges encountered by the HITers.
- Open Chat Platform: An instant messages platform (Chat) facilitates real-time communication and collaboration among HITers, reviewers and project managers located all around the world. This tool serves as a forum for discussions, knowledge sharing, and problem-solving, resulting in a supportive community environment.
Conclusion : a tailored-made process built to reach the highest quality in melanoma detection.
In conclusion, the meticulous selection and training process built by isahit empowers HITers to deliver high-quality melanoma annotations crucial for the advancement of the iToBoS project. Through a combination of important selection criteria, comprehensive training, ongoing testing, and continuous support, isahit ensures that HITers have everything they need in terms of expertise and resources, to excel in their annotation tasks, ultimately contributing to the success of AI models in melanoma detection.
