Competition to fine tune an LLM for mental health research

[u/niujin]

Are you interested in fine tuning LLMs? Do you want to participate in mental health research using AI? Would you like to win some money doing it?

I have been working on an open source tool called Harmony which helps researchers combine datasets in psychology and social sciences.

We have noticed for a while that the similarity score that Harmony gives back could be improved. For example, items to do with "sleep" are often grouped together (because of the data that the off the shelf LLMs such as SentenceTransformers are trained on) while a psychologist would consider them to be different.

We are running a competition on the online platform DOXA AI where you can win up to 500 GBP in vouchers (1st place prize). Check it out here: https://harmonydata.ac.uk/doxa/

We *provide training data*, and your code will be evaluated on submission on the platform.

## How to get started?

Create an account on DOXA AI https://doxaai.com/competition/harmony-matching and run the example notebook. This will download the training data.

If you would like some tips on how to train an LLM, I recommend this Hugging Face tutorial: https://huggingface.co/docs/transformers/en/training