CLIPE (http://clipe-itn.eu/) is a Marie Sklodowska-Curie Innovative Training Network in the framework of Horizon 2020, starting on March 1st, 2020 with a four-year duration. The network consists of 9 universities/research centers and 5 industrial partners.
Supervisor Michael J. Black
Max-Planck Institute for Intelligent Systems, Department of Perceiving Systems
The primary objective of CLIPE is to train a generation of innovators and researchers in the field of virtual characters simulation and animation. Advances in technology are pushing towards making VR/AR worlds a daily experience. Whilst virtual characters are an important component of these worlds, bringing them to life and giving them interaction and communication abilities requires highly specialized programming combined with artistic skills, and considerable investments: millions spent on countless coders and designers to develop video-games is a typical example. The research objective of CLIPE is to design the next-generation of VR-ready characters. CLIPE is addressing the most important current aspects of the problem, making the characters capable of:
- behaving more naturally;
- interacting with real users sharing a virtual experience with them;
- being more intuitively and extensively controllable for virtual worlds designers.
To meet our objectives, the CLIPE consortium gathers some of the main European actors in the field of VR/AR, computer graphics, computer animation, psychology and perception. CLIPE also extends its partnership to key industrial actors of populated virtual worlds, giving students the ability to explore new application fields and start collaborations beyond academia.
The project has the objective to 1. Develop motion capture scenarios that focus on optimizing face, hands, feet, body, and clothing capture, 2. Develop initial statistical models for holistic full body animation, 3. Develop deep learning based methods to explore in-the-wild images and videos to infer detailed representations of pose, shape, expression, clothing, and interaction of people, 4. Develop methods utilizing learning-based representations of people to enrich the initial statistical models towards realistic characters.
Expected results are: 1. Face, Hand, Feet, Body, Clothing and Interaction Database: Database of captures of high resolution 4D data with faces, hands, Feet, Body and Clothing from these we will build statistical models, 2. Development of deep learning techniques to learn the detailed representations of pose, shape, expression, clothing, and interaction of people from in-the-wild images and videos, 3. Development of new techniques that learn realistic visual characters from high-resolution 4D data and daily images and Internet videos.
Three secondments are planned as part of the PhD project for example at: UCL (3 months, developing interaction protocols and sharing expertise in eye-tracking), INRIA (3 months, building up the DB), Amazon (4 months, industry applications)
As part of the CLIPE project, you will participate in 3 training workshops, one online workshop, as well as an introductory networking event and a final conference. The projected is funded for 36 months.
- not to have resided or carried out their main activity (work, studies, etc.) in the country where the PhD takes place, for more than 12 months in the 3 years immediately prior to the recruitment date;
- be in the first 4 years of their research career and not have a doctoral degree (The 4 years are measured from the date when the applicant obtained the degree which would formally entitle him/her to embark on a PhD);
- have a Master's degree in Computer Science, Mathematics or Engineering (or an equivalent diploma allowing them to pursue a PhD);
- excellent/ good oral and written English language skills (if English is not his/her first language);
- good skills in scientific writing and results presentation.
If you fulfil the eligibility requirements, please contact us via email as soon as possible (contact details per institution are shown below). Please, also attach a detailed Curriculum Vitae including undergraduate/ postgraduate degree results and a list of publications (if any).
- A multidisciplinary research network with the possibility to work in different research centres and top industrial partners across Europe.
- Full time PhD scholarships for 3 years with a very competitive (gross) salary comprising of: mobility allowance of 600 EUR/month, family allowance of 500 EUR/month (depending on family status) in addition to living allowance as shown in the table below:
|PhD Host Country
||Living Allowance Amount (EUR/ month)
Please direct your applications to firstname.lastname@example.org and mention CLIPE and the ESR number of the project you are applying to in the subject line. The position is open until filled but preference will be given to applications received by September 1, 2020. The Max Planck Society is committed to increasing the number of individuals with disabilities in its workforce and therefore encourages applications from such qualified individuals. The Max Planck Society strives for gender equality and diversity. Furthermore, the Max Planck Society seeks to increase the number of women in its workforce in those areas where they are underrepresented and therefore explicitly encourages women to apply.
Starting date is by September 2020. For more information about the project, please visit: http://clipe-itn.eu/
This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under the Marie Sklodowska-Curie grant agreement No 860768