A major strategy in process industries is to run industrial processes at the highest economic performance through involvement of hardware and software solutions. Traditionally petroleum industries are using controllers ranging from proportional controllers to advanced predictive based controllers such as Model Predictive Controllers (MPC). The  most of these systems were developed 20-30 years ago and requires careful analysis of the process dynamics, development of abstract mathematical models and derivation of a control law that meets certain design criteria. The drawbacks of this well-proven technology are mainly related to complexity of dynamic models and their continuous maintenance requirements to accommodate feedstock changes, process improvements and deviations in product demands as a result of the changing global economy.

Just like internet companies that can create high value by optimizing the commercial assets in the consumer market by data analytics, petroleum industry can also generate high value by optimizing their assets from analytics of machine and processes data they have acquired from the operations and productions. Modern machine and deep learning technologies enables simply interacting with the process and incrementally improving control behavior.

The AI-based approaches started to emerge in the late 1990s as the third generation of optimization methods. The idea is to use a limited number of design trials (called sample points) to construct a machine-learning model between the design variables and objectives/constraints. However, very little was made in AI-based approaches and more than 85% of data science projects fail to make it into production.

The purpose of Modcon-AI HW/SW package is to provide refinery with set of modern optimization tools, which enables connectivity, validation and prediction of main KPIs, to take the correct decisions to maintain and improve effective industrial processes management. The implemented in this solution artificial neural network (NN) dynamic models enables to calculate and predict physical properties and chemical compositions for different process streams, and proposes required set points, that will accomplish the calculated predictions.

Deep reinforcement learning (DRL) is a powerful machine learning technique, which can be effectively used to optimize industrial processes for different strategic goals, allowing to shift focus intelligently and confidently. Reinforcement learning makes use of algorithms that do not rely only on historical data sets, to learn to make a prediction or perform a task. Just like we humans learn using trial and error, these algorithms also do the same. A reinforcement learning agent is given a set of actions that it can apply to its environment to obtain rewards or reach a certain goal. These actions create changes to the state of the agent and the environment. The DRL agent receives rewards based on how its actions bring it closer to its goal.

DRL agents can start by knowing nothing about their environment and selecting random actions. Because reinforcement learning systems figure things out through trial and error, it works best in situations where an action or sequence of events is rapidly established, and feedback is obtained quickly to determine the next course of action — there is no need for reams of historical data for reinforcement learning to crunch through. That makes DRL perfectly suitable for hydrocarbons processing optimization tasks using established metrics in the form of inputs, actions, and rewards.

Being a powerful tool, which requires no historical data for reinforcement learning, DRL has one significant weakness, which makes it more difficult to implement for hydrocarbons processing with wide ranges of operation. DRL is likely to improve performance only where the pre-trained parameters are already close to yielding the correct process steams quality. The observed gains may be due to effects unrelated to the training signal, but rather from changes in the shape of the distribution curve. Therefore, there is a need in real-time monitoring of process yields, rather than only their prediction using the pre-trained models. This can be reached using the on-line analyzers installed in the process to determine the chemical composition or physical properties of substances involved in hydrocarbons processing.

Economic managements requires to combine different technologies, hardware as well as software that provides an entire overview of the operation of the process units based on quality data, as well as marketing, volume, supply of crude oils, energy etc. Combining logistic and technical hardware and software forms a basic tool from managers to operators to take the correct decisions to maintain and improve successful refinery management.

Further investment in the PA, AI and ML technologies for sustainable development means for Modcon adopting business strategies and developing advanced technologies that meet the needs of the enterprise today while protecting, sustaining and enhancing the human and natural resources that will be needed in the future.