Antoniuk V. Development of a cross-platform system for automating processes and interacting with computerized devices

Modern technological conditions are characterized by a rapid increase in the complexity and volume of routine tasks. This, in turn, leads to an increased need for effective tools for managing processes and tasks. Traditional methods based on manual data entry and repetitive actions are becoming less and less productive and require a significant investment of time and resources. One of the key factors driving this need is the growing interaction between humans and computerized systems. In today's world, people are constantly interacting with computers, smartphones, tablets, and other devices to perform a variety of tasks. This interaction should be simple, intuitive, and effective to minimize the time and effort required to achieve goals. Today, many existing systems do not meet these requirements. They are often complex, intricate, and require specialized knowledge or skills to use. This leads to errors, inefficiencies, and user dissatisfaction. The increase in the complexity and volume of routine tasks, the growing interaction between people and computerized systems in modern technological conditions requires the creation of improved interfaces that can increase the intuitiveness and efficiency of process and task management with minimal human intervention. This dissertation focuses on the development of an advanced cross-platform process automation system that provides an intuitive associative GUI between users and computerized devices, efficient customization of process interactions, integration with any existing third-party services such as Slack, Amazon S3 Files, SendGrid, etc. The development of such advanced cross-platform process automation systems is an urgent and promising task that has significant potential to improve the productivity and quality of life of people in today's digital world. The study is aimed at a comprehensive analysis of the current state of automated interactive communication technologies, identifying the main problem points and opportunities for further progress. The conceptual part emphasizes the importance of the development of interactive systems to improve the quality of human-machine interaction, as well as the important role of artificial intelligence in this process. The need for an in-depth study of the adaptation of modern technologies to specific user requirements and use cases stands out. The scientific novelty of the obtained results is as follows: 1. For the first time, the concept of an associative graphical interface in process automation systems based on the use of graphic keys for determining commands is proposed, which allows to increase the intuitiveness and efficiency of process and task management, which is especially relevant in the context of increasing the complexity and volume of tasks. 2. For the first time, a software architecture for process automation has been developed, which is based on a combination of a plug-in microkernel and a pure architecture, which allows you to optimize the structure of the program code, reducing dependencies and duplication, which helps to increase the readability, maintainability and testability of the code, as well as provides an improvement in quality metrics, including a decrease in cyclomatic complexity and an increase in the support index. 3. The methodology of software integration with other business systems and services has been improved through the development of modular cross-platform connectors, which significantly expand the possibilities of automation and integration of enterprise software. 4. For the first time, the technology of using the AI language model for the automatic construction of macros in automation systems is proposed, which allows users to build workflows, describing only the requirements for them, without the need to delve into knowledge of programming or even the system itself. 5. The method of recognition of graphic gestures has been improved, which made it possible to recognize gestures that consist of several lines, thereby expanding the number of possible associations for more complex commands. The practical significance of the work lies in the creation of an effective and flexible cross-platform system for automating processes and interacting with computerized devices, which can be used in the industrial sphere to control production processes, information technology for infrastructure monitoring, "Smart Home" or "Smart City" systems for managing urban services, etc. The developed process automation system has significant practical significance for enterprises and organizations of different sizes. It can be used to automate a wide range of tasks, such as order processing, project management, customer service, financial accounting, and more.