Sd-25130 Phd in Llm Testing

Description
**Temporary contract | 14+22(+12) months | Belval**:
**Are you passionate about research? So are we Come and join us**:
The Luxembourg Institute of Science and Technology (LIST) is a Research and Technology Organization (RTO) active in the fields of materials, environment and IT. By transforming scientific knowledge into technologies, smart data and tools, LIST empowers citizens in their choices, public authorities in their decisions and businesses in their strategies.

**How will you contribute?**

You will be contributing to the research and development of the smart software platform for the BESSER project, especially in the context of a new EU project targeting the development of multi-lingual Large Language Models (LLMs) that could be integrated in the development of new software systems, e.g. targeting the digital transformation of the public administration.

In particular, you’ll be working on the testing and assessment of LLMs, especially focusing on their multi-cultural and multi-lingual capabilities to better understand the implications of using them across different contexts.

You will be in charge of:

- Defining proper tests to assess cultural and linguistic capabilities of LLMs, especially regarding low-resource languages
- Create benchmarks and testing pipelines to automatically evaluate existing LLMs on these dimensions
- Explore ways to minimize the impact of their limitations.
- Actively participate in the EU project representing the LIST activities
- Write research papers and create materials presenting and promoting your work

While we first focus on Luxembourgish language and culture in the empirical evaluation, the work also involves generalizing the tests and benchmarks to facilitate their adaptation to other languages, especially low-resource ones.

**Education**

Master in Computer Science or similar areas

**Experience and skills in**
- LLMs
- AI testing
- Natural Language Processing
- Software development
- Conducting and publishing research on some of these topics

**Language skills**
- Good level both written and spoken English. Given the context of the project, working knowledge of other languages is a plus

**Your LIST benefits**
- An organization with a passion for impact and strong RDI partnerships in Luxembourg and Europe that works on responsible and independent research projects
- Sustainable by design, empowering our belief that we play an essential role in paving the way to a green society
- Innovative infrastructures and exceptional labs occupying more than 5,000 square metres, including innovations in all that we do
- An environment encouraging curiosity, innovation and entrepreneurship in all areas
- Personalized learning programme to foster our staff’s soft and technical skills
- Multicultural and international work environment with more than 50 nationalities represented in our workforce
- Diverse and inclusive work environment empowering our people to fulfil their personal and professional ambitions
- Gender-friendly environment with multiple actions to attract, develop and retain women in science
- 32 days’ paid annual leave, 11 public holidays, 13-month salary, statutory health insurance
- Flexible working hours, home working policy and access to lunch vouchers
- A motivation letter oriented towards the position and detailing your experience
- A scientific CV with contact details
- List of publications (and patents, if applicable)
- Contact details of 2 references

**Application procedure and conditions**

We kindly request applicants to provide their nationality for statistical purposes only, as part of our commitment to promoting diversity and ensuring equal opportunities in our workforce. This information will be kept confidential and will not be used for any discriminatory purposes.

LIST is dedicated to maintaining an inclusive work environment and is an equal opportunity employer. We are committed to attracting, hiring, and retaining a diverse workforce. All applicants will be considered for employment without discrimination based on national origin, race, colour, gender, sexual orientation, gender identity, marital status, religion, age, or disability.

Languages English Experience 0+ years