Autonomous Lifelong learnIng intelLigent Systems – ALLIES
Standard machine learning systems require massive data and huge processing infrastructures, but the main limitation to their spreading comes from the need of the empirical and rare knowledge of an experienced data scientist able to set and adjust their behavior over time. The ALLIES project will lay the foundation for development of autonomous intelligent systems sustaining their performance across time.
Such unsupervised system will be able to auto-update and perform self-evaluation to be aware of the evolution of its own knowledge acquisition. It should adapt to a changing environment by following a given learning scenario that balances the importance of performance on past and present data to avoid unwanted regression. Such systems could not be developed without adapted metrics and protocols enabling their objective and reproducible evaluation. This evaluation should continuously assess the performance on the given task and quantify the effort required to reach it in terms of unsupervised data collected by the system and of interaction with humans in the case of active-learning. The ALLIES project will develop, evaluate and disseminate those metrics and protocols. They will be available to european actors via an open evaluation platform dedicated to reproducible research. An evaluation campaign and a workshop will be organised to engage the community on this path. By publicly releasing the evaluation protocols and data, by releasing a dedicated evaluation platform and by developing autonomous systems for two tasks: machine translation and speaker diarization, we believe that the ALLIES project will boost the development of intelligent lifelong learning systems in Europe.
Monsieur Anthony Larcher (LABORATOIRE D'INFORMATIQUE DE L'UNIVERSITE DU MAINE (LIUM))
The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.
IDIAP IDIAP Research Institute
UPC Universitat Politècnica de Catalunya
LNE Laboratoire national de métrologie et d'essais
LIUM LABORATOIRE D'INFORMATIQUE DE L'UNIVERSITE DU MAINE (LIUM)
Help of the ANR 942,134 euros
Beginning and duration of the scientific project: November 2017 - 36 Months