1-3 postdoctoral researchers or project researchers to train large language models

Join Europe’s leading experts to create the next generation of European Generative AI models!TurkuNLP (TurkuNLP) is an internationally renowned multidisciplinary research group specialising in the development of machine learning-based resources, models and tools for natural language processing (NLP) tasks using internet-scale data. In recent years, TurkuNLP has created several openly available Transformer-based language models, such as FinBERT and FinGPT, Finland’s leading BERT and GPT-3 models, and subsequently the Poro and Viking models. TurkuNLP was also selected as a pilot user of LUMI, Europe’s largest supercomputer, and the group has a long tradition of using high performance computing in NLP.TurkuNLP is looking for 1-3 fixed-term postdoctoral researchers or project researchers for positions training large-scale language models. The work will start on 1.1.2025 or according to mutual agreement. The positions are fixed-term (3 years) until 31.12.2027, with a possibility for extension. The work can be done either part-time or full-time, depending on the candidates’ wishes and availability.The positions are part of the High Performance Language Models (HPLT) research project funded by Horizon Europe and possible follow-up projects. The project will create a new generation of high performance language models covering all European languages and their fine-tuning using several terabytes of text data and Europe’s largest supercomputer LUMI. For more information, see https://hplt-project.org/.Description of the positionThe role offers an excellent opportunity to contribute to the development of large language models in a research team with cutting-edge expertise, data and computational resources. The HPLT project differs from many similar projects in that (1) it has millions of GPU-hours of computational resources at its disposal, (2) it has access to very large textual data sets, including the Internet Archive, and (3) it is a multinational collaboration combining the NLP expertise of several research groups and companies in the field. The project is well networked and interacts regularly with key players in the field. As part of the project, it is also possible, but not compulsory, to complete a PhD degree under a separate contract. If you are interested in this possibility, please mention it in your motivation letter.Main tasks and responsibilitiesYou will work as part of the TurkuNLP HPLT project team. The main tasks will be related to the training and evaluation of very large multilingual language models from scratch. In particular, the project will focus on training models on the AMD architecture of the LUMI supercomputer. Postdoctoral researchers will also be expected to participate in mentoring junior researchers and other similar tasks typically associated with post docs in academia.

Who we are looking for
——————
Qualification requirementsThe qualification requirements for the positions are stated in the University of Turku Rules of Procedure: Organisation and Management of the University of Turku.A person selected for the post of Postdoctoral researcher is required to have a doctoral degree and the ability to conduct independent scientific work as well as having the necessary teaching skills.  A person selected for the post of Project researcher is required to have a higher university degree. When assessing the merits of the applicants, special emphasis will be placed on competence and practical expertise in the field in question.The higher university degree must be completed by the end of the application period. In exceptional cases, we may also consider applicants who have completed almost all the studies required for a Master’s degree in a field relevant to the position. In such cases, the title will be research assistant in the beginning of the employment.What we expect from the candidatesThe project is of technical nature and preference will be given to candidates with previous experience, which will allow a rapid start.We expect good programming skills. In particular, intermediate to advanced knowledge of Python and some knowledge of bash scripts and the command line environment are prerequisites for successful participation in the project. We also expect previous experience in deep learning, preferably with Pytorch.The following are considered a significant advantage:Experience in training generative language models, even small ones.Experience in training large-scale, distributed deep learning models in a supercomputing environment.Experience in dealing with large textual datasets. Salary and trial periodThe salaries are determined in accordance with the university salary system for teaching and research personnel.For a postdoctoral researcher the salary will be in the beginning of employment around 3500–3800 euros/month, and for a project researcher around 2440–2600 euros/month, depending on previous experience and skills.For a research assistant the salary will be in the beginning of employment around 2200–2350 euros/month, depending on previous experience and skills. The amount of the salary is defined when the employment contract is prepared. A six (6) month trial period applies to the positions. University of Turku offers extensive occupational health care, affordable sports facilities and holiday pay. How to applyApplications must be submitted at the latest on Thursday, 5 December 2024 (16:00) using the electronic application form of the University of Turku on the following address: https://www.utu.fi/careers.The link to the application system is at the beginning of this announcement (“Apply for this position”).  The application must be accompanied by a curriculum vitae (CV), a copy of degree certificates with translation in English or Finnish, a list of publications, a study transcript (research assistant position) and a letter of motivation. Further informationFor further information on the scientific project, please contact Sampo Pyysalo, [email protected]. Regarding the recruitment process, please contact HR Specialist Nina Reini ([email protected]).The University of Turku reserves the right, for justified reasons, to leave a vacancy open, to extend the application deadline, to reopen the application process and to consider applicants who have not submitted applications by the deadline.We value equality and diversity in our working community and encourage qualified applicants from all backgrounds to apply for our open positions. Find out more about us as an employer on the “Come and work for us! ” page.The European Commission has awarded the University of Turku the right to use the HR Excellence in Research logo. The logo is a token of the University’s commitment to continuous development of the position and working conditions of researchers according to the guidelines set forth in the European Charter for Researchers.  The university offers good support and orientation for international hires. Please learn more about the Finnish culture and relocation to Finland: Why to choose Turku as a place to study and work: https://www.turku.fi/en/study-turku/welcome-turku/5-reasons-choose-turku   City of Turku Welcome visitor Career in Southwest Finland International House of Turku Working culture: infoFinland.fi This is Finland Finland – a superpower of education and innovations | University of Turku (utu.fi)

Department of Computing
——————
The Department of Computing educates professionals for the modern digitalised society. Central themes of teaching and research include Digitalisation, Machine Learning, Autonomous and Intelligent Systems, Cybersecurity and Health Technology. The Faculty of Technology is the newest faculty of the University of Turku, it was established in the beginning of 2021. The Faculty consists of the Department of Computing, Department of Biotechnology and the Department of Mechanical and Materials Engineering. We have more than 2,000 graduate and postgraduate students and circa 400 employees, 50 of whom are professors. Our faculty is an international, multicultural and diverse work community.The University of Turku is an inspiring and international academic community of 25,000 students and staff in Southwest Finland. We build a sustainable future with multidisciplinary research, education, and collaboration. With us, your work will have a significant impact and relevance in the changing world.See our open vacancies
Information for the applicantThe application form cannot be saved as a draft. However, after submitting you can return to edit your application via the link you receive by email. The application can be edited until the application deadline.You have 6 hours to complete your application before the timeout.Instructions for submitting a job application