Stochastic approximation algorithm for industrial process optimisation
Algoritmo de aproximaciones estocásticas para la optimización de procesos industriales
DOI:
https://doi.org/10.15446/ing.investig.v31n3.26393Keywords:
stochastic approximation algorithm, dependent variable, independent variable, iterative process, simulation (en)algoritmos de aproximaciones estocásticas, variables independientes, variables dependientes, proceso iterativo, simulación (es)
Downloads
Stochastic approximation algorithms are alternative linear search methods for optimising control systems where the functional relationship between the response variable and the controllable factors in a process and its analytical model remain unknown. These algorithms have no criteria for selecting succession measurements ensuring convergence, meaning that, when implemented in practice, they may diverge with consequent waste of resources. The objective of this research was to determine industrial processes' optimum operating conditions by using a modified stochastic approximation algorithm, where its succession measurements were validated by obtaining response variable values for each iteration through simulation. The algorithm is presented in nine stages; its first six describe which are process independent and dependent variables, the type of experimental design selected, the experiments assigned and developed and the second order models obtained. The last three stages describe how the algorithm was developed, and the optimal values of the independent variables obtained. The algorithm was validated in 3 industrial processes which it was shown to be efficient for determining independent variables' optimum operating conditions (temperature and time): the first three iterations were obtained at 66°C in 3 hours 42 minutes for process 1, unlike processes 2 and 3 where the first iteration was obtained at 66°C in 6 hours 06 minutes and 80°C in 5 hours 06 minutes, respectively.
Los algoritmos de aproximaciones estocásticas son métodos alternativos de búsqueda lineal para optimizar o controlar sistemas donde la relación funcional entre la variable de respuesta y los factores controlables de un proceso y su modelo analítico son desconocidos. En estos algoritmos no existe un criterio en la selección de sus medidas de sucesión que garanticen la convergencia, lo cual puede llevar a que al implementarlos en la práctica diverjan, con el consecuente desperdicio de recursos. El objetivo de la investigación es determinar las condiciones óptimas de operación de procesos industriales mediante un algoritmo de aproximaciones estocásticas modificado, donde sus medidas de sucesión son validadas al obtener valores de la variable de respuesta de cada iteración mediante simulación. El algoritmo es presentado en nueve etapas. En sus primeras seis se describen cuáles son las variables independientes y dependientes del proceso, se selecciona la clase del diseño experimental, se asignan y desarrollan los experimentos y se obtienen los modelos de segundo orden; en las últimas tres etapas se desarrolla el algoritmo y se obtienen los valores óptimos de las variables independientes. El algoritmo se validó en tres procesos industriales, demostrándose que es eficiente para determinar las condiciones óptimas de operación de las variables independientes (temperatura y tiempo); en el proceso 1 se obtienen en las primeras tres iteraciones en 66 °C y 3 h 42 min, a diferencia de los procesos 2 y 3, que se obtienen en la primera iteración con 66 °C y 6 h 06 min y 80 ° C y 5 h 06 min, respectivamente.
Downloads
References
Andradóttir, S., A stochastic Approximation Algorithm with Varying Bounds., Operations Research, Vol. 43, número 6, 1995i, pp 1037-1048.
Andradóttir, S., A method for Discrete Stochastic Approximation., Management Science, Vol. 41, número 12, 1995ii, pp 1946 -1961.
Andradóttir, S., A Scaled Stochastic Approximation Algorithm., Management Science, Vol. 42, número 4, 1996, pp 475-498.
Blum, J.R., Multidimensional Stochastic Approximation Methods., Annals of Mathematical Statistic, Vol. 25, 1954, pp 737-744.
Brooks, O., Solving Discrete Resource Allocation Problems using the Simultaneous Perturbation Stochastic Approximation (SPSA) Algorithm, Proceedings of the Spring Simulation Multi-conference, 25-29 March 2007, Norfolk, VA, USA, pp. 55- 62.
Chien, S.I., Luo, J., Optimization of Dynamic Ramp Metering Control with Simultaneous Perturbation Stochastic Approximation., Control and Intelligent Systems, scheduled for fall 2008 issue, pp 8-10.
Chin, D.C., Comparative Study of Stochastic Algorithms for System Optimization Based on Gradient Approximation., IEEE Transaction on Systems, Man, and Cybernetics-part b: Cybernetics, Vol. 27, número 2, 1997, pp 244-249.
Delyon, B., General Results on the Convergence of Stochastic Algoritms., IEEE Transaction on Automatic Control, Vol. 41, número 3, 1996, pp 1245-1255.
Fu, M.C., Ho, Y.C., Using perturbation analysis for gradient estimation, averaging and updating in a stochastic approximation algorithm., Winter Simulation Conference Proceedings of the 20th conference on Winter simulation, 1988, pp 509-517.
Kiefer, J., Wolfowitz, J., Stochastic Estimation of the Maximum of a Regression Function., Annals of Mathematical Statistic, Vol. 23, número 3, 1952, pp. 462-466.
Kulkarni, S.R., Horn, C.S., An Alternative Proof for Convergence of Stochastic Approximation Algorithms., IEEE Transactions on Automatic Control, Vol. 41, número 3, 1996, pp 419-424.
Kushner, H.J., Clark, D.J., Stochastic Approximation Methods for Constrained and Unconstrained Systems., New York, Springer-Verlag, 1978.
Maeda, Y., Time difference Simultaneous Perturbation Method., Electronic Letters, Vol. 32, número 11, 1996, pp 1016-1017.
Maryak, J.L., Chin, D.C., Global Random Optimization by Simultaneous Perturbation Stochastic Approximation., IEEE Transactions on Automatic Control, vol. 53, número 3, 2008, pp. 780-783.
Montgomery, D.C., Design and Analysis of Experiments, Seventh ed., NJ, John Wiley & Sons, 2009. pp 360-368
Polyak, B.T., New Method of Stochastic Approximation Type Procedures., Automatica I telemekhanika, Vol. 51 (1990) pp 98-107 en Ruso, trasladado al Inglés en Automatica Remote Control, Vol. 51, 1991, pp 937-945.
Polyak, B.T., Juditsky, A.B., Acceleration of Stochastic Approximation by Avering., SIAM Journal on Control and Optimization, Vol. 30, número 4, 1992, pp 838-855.
Robbins, H., Monro, S., A Stochastic Approximation Method., Annals of Mathematical Statistic, Vol.22, 1951, pp 400-407.
Spall, J.C., Implementation of the Simultaneous Perturbation Algorithm Stochastic Optimization., IEEE Transactions on Aerospase end Electronic Systems, Vol. 34, Número 3, 1998, pp 817-823.
Spall, J.C., Introduction to Stochastic Search and Optimization Estimation., Simulation and Control, NJ, John Wiley & Sons, Hoboken, NJ. 2003.
License
Copyright (c) 2011 Jesús Everardo Olguín Tiznado, Rafael García Martínez, Claudia Camargo Wilson, Juan Andrés López Barreras

This work is licensed under a Creative Commons Attribution 4.0 International License.
The authors or holders of the copyright for each article hereby confer exclusive, limited and free authorization on the Universidad Nacional de Colombia's journal Ingeniería e Investigación concerning the aforementioned article which, once it has been evaluated and approved, will be submitted for publication, in line with the following items:
1. The version which has been corrected according to the evaluators' suggestions will be remitted and it will be made clear whether the aforementioned article is an unedited document regarding which the rights to be authorized are held and total responsibility will be assumed by the authors for the content of the work being submitted to Ingeniería e Investigación, the Universidad Nacional de Colombia and third-parties;
2. The authorization conferred on the journal will come into force from the date on which it is included in the respective volume and issue of Ingeniería e Investigación in the Open Journal Systems and on the journal's main page (https://revistas.unal.edu.co/index.php/ingeinv), as well as in different databases and indices in which the publication is indexed;
3. The authors authorize the Universidad Nacional de Colombia's journal Ingeniería e Investigación to publish the document in whatever required format (printed, digital, electronic or whatsoever known or yet to be discovered form) and authorize Ingeniería e Investigación to include the work in any indices and/or search engines deemed necessary for promoting its diffusion;
4. The authors accept that such authorization is given free of charge and they, therefore, waive any right to receive remuneration from the publication, distribution, public communication and any use whatsoever referred to in the terms of this authorization.










