ABOUT THE CONCEPT OF BUILDING A DISTRIBUTED ECOSYSTEM FOR STORING AND PROCESSING DATA WITHIN THE FRAMEWORK OF AN IT SOLUTIONS DEVELOPMENT PLATFORM

Speaker

Татьяна Автомонова

Description

The article proposes a concept for creating a distributed platform (DP) to improve the quality and accelerate development in the field of IT technologies. The role of database management systems (DBMS) for building a system for collecting, storing and processing data when building a DP, where a large amount of heterogeneous data is collected within a single platform, is considered.
By creating a local development environment within the platform and deploying the required software, developers will be able to fully work with data, for example, gain direct read access to data streams (Kafka, RabbitMQ, gRPS), connect to raw or processed data suitable for solving a given problem and stored in a data ecosystem (EDS), as well as find a ready-made solution and apply it to their own data. In addition, it is possible to create distributed data sets from the EDS, and then use data analysis systems integrated into the platform. This is especially important when using artificial intelligence tools, where large volumes of raw and prepared data are needed to train and test models based on neural networks. The platform can also be used to provide services in the formats of data as a service and function as a service.

Authors

Dr Геннадий Дик Татьяна Автомонова

Co-authors

Alexander Bogdanov (St. Petersburg University St. Petersburg, Russia) Mr Александр Дик Виктор Юров

Presentation materials

There are no materials yet.