Published

2011-09-01

Stochastic approximation algorithm for industrial process optimisation

Algoritmo de aproximaciones estocásticas para la optimización de procesos industriales

DOI:

https://doi.org/10.15446/ing.investig.v31n3.26393

Keywords:

stochastic approximation algorithm, dependent variable, independent variable, iterative process, simulation (en)
algoritmos de aproximaciones estocásticas, variables independientes, variables dependientes, proceso iterativo, simulación (es)

Authors

  • Jesús Everardo Olguín Tiznado Universidad Autónoma de Baja California
  • Rafael García Martínez Instituto Tecnológico del Valle del Yaquí
  • Claudia Camargo Wilson Universidad Autónoma de Baja California
  • Juan Andrés López Barreras Universidad Autónoma de Baja California

Stochastic approximation algorithms are alternative linear search methods for optimising control systems where the functional relationship between the response variable and the controllable factors in a process and its analytical model remain unknown. These algorithms have no criteria for selecting succession measurements ensuring convergence, meaning that, when implemented in practice, they may diverge with consequent waste of resources. The objective of this research was to determine industrial processes' optimum operating conditions by using a modified stochastic approximation algorithm, where its succession measurements were validated by obtaining response variable values for each iteration through simulation. The algorithm is presented in nine stages; its first six describe which are process independent and dependent variables, the type of experimental design selected, the experiments assigned and developed and the second order models obtained. The last three stages describe how the algorithm was developed, and the optimal values of the independent variables obtained. The algorithm was validated in 3 industrial processes which it was shown to be efficient for determining independent variables' optimum operating conditions (temperature and time): the first three iterations were obtained at 66°C in 3 hours 42 minutes for process 1, unlike processes 2 and 3 where the first iteration was obtained at 66°C in 6 hours 06 minutes and 80°C in 5 hours 06 minutes, respectively.

Los algoritmos de aproximaciones estocásticas son métodos alternativos de búsqueda lineal para optimizar o controlar sistemas donde la relación funcional entre la variable de respuesta y los factores controlables de un proceso y su modelo analítico son desconocidos. En estos algoritmos no existe un criterio en la selección de sus medidas de sucesión que garanticen la convergencia, lo cual puede llevar a que al implementarlos en la práctica diverjan, con el consecuente desperdicio de recursos. El objetivo de la investigación es determinar las condiciones óptimas de operación de procesos industriales mediante un algoritmo de aproximaciones estocásticas modificado, donde sus medidas de sucesión son validadas al obtener valores de la variable de respuesta de cada iteración mediante simulación. El algoritmo es presentado en nueve etapas. En sus primeras seis se describen cuáles son las variables independientes y dependientes del proceso, se selecciona la clase del diseño experimental, se asignan y desarrollan los experimentos y se obtienen los modelos de segundo orden; en las últimas tres etapas se desarrolla el algoritmo y se obtienen los valores óptimos de las variables independientes. El algoritmo se validó en tres procesos industriales, demostrándose que es eficiente para determinar las condiciones óptimas de operación de las variables independientes (temperatura y tiempo); en el proceso 1 se obtienen en las primeras tres iteraciones en 66 °C y 3 h 42 min, a diferencia de los procesos 2 y 3, que se obtienen en la primera iteración con 66 °C y 6 h 06 min y 80 ° C y 5 h 06 min, respectivamente.

Downloads

Download data is not yet available.

References

Andradóttir, S., A stochastic Approximation Algorithm with Varying Bounds., Operations Research, Vol. 43, número 6, 1995i, pp 1037-1048.

Andradóttir, S., A method for Discrete Stochastic Approximation., Management Science, Vol. 41, número 12, 1995ii, pp 1946 -1961.

Andradóttir, S., A Scaled Stochastic Approximation Algorithm., Management Science, Vol. 42, número 4, 1996, pp 475-498.

Blum, J.R., Multidimensional Stochastic Approximation Methods., Annals of Mathematical Statistic, Vol. 25, 1954, pp 737-744.

Brooks, O., Solving Discrete Resource Allocation Problems using the Simultaneous Perturbation Stochastic Approximation (SPSA) Algorithm, Proceedings of the Spring Simulation Multi-conference, 25-29 March 2007, Norfolk, VA, USA, pp. 55- 62.

Chien, S.I., Luo, J., Optimization of Dynamic Ramp Metering Control with Simultaneous Perturbation Stochastic Approximation., Control and Intelligent Systems, scheduled for fall 2008 issue, pp 8-10.

Chin, D.C., Comparative Study of Stochastic Algorithms for System Optimization Based on Gradient Approximation., IEEE Transaction on Systems, Man, and Cybernetics-part b: Cybernetics, Vol. 27, número 2, 1997, pp 244-249.

Delyon, B., General Results on the Convergence of Stochastic Algoritms., IEEE Transaction on Automatic Control, Vol. 41, número 3, 1996, pp 1245-1255.

Fu, M.C., Ho, Y.C., Using perturbation analysis for gradient estimation, averaging and updating in a stochastic approximation algorithm., Winter Simulation Conference Proceedings of the 20th conference on Winter simulation, 1988, pp 509-517.

Kiefer, J., Wolfowitz, J., Stochastic Estimation of the Maximum of a Regression Function., Annals of Mathematical Statistic, Vol. 23, número 3, 1952, pp. 462-466.

Kulkarni, S.R., Horn, C.S., An Alternative Proof for Convergence of Stochastic Approximation Algorithms., IEEE Transactions on Automatic Control, Vol. 41, número 3, 1996, pp 419-424.

Kushner, H.J., Clark, D.J., Stochastic Approximation Methods for Constrained and Unconstrained Systems., New York, Springer-Verlag, 1978.

Maeda, Y., Time difference Simultaneous Perturbation Method., Electronic Letters, Vol. 32, número 11, 1996, pp 1016-1017.

Maryak, J.L., Chin, D.C., Global Random Optimization by Simultaneous Perturbation Stochastic Approximation., IEEE Transactions on Automatic Control, vol. 53, número 3, 2008, pp. 780-783.

Montgomery, D.C., Design and Analysis of Experiments, Seventh ed., NJ, John Wiley & Sons, 2009. pp 360-368

Polyak, B.T., New Method of Stochastic Approximation Type Procedures., Automatica I telemekhanika, Vol. 51 (1990) pp 98-107 en Ruso, trasladado al Inglés en Automatica Remote Control, Vol. 51, 1991, pp 937-945.

Polyak, B.T., Juditsky, A.B., Acceleration of Stochastic Approximation by Avering., SIAM Journal on Control and Optimization, Vol. 30, número 4, 1992, pp 838-855.

Robbins, H., Monro, S., A Stochastic Approximation Method., Annals of Mathematical Statistic, Vol.22, 1951, pp 400-407.

Spall, J.C., Implementation of the Simultaneous Perturbation Algorithm Stochastic Optimization., IEEE Transactions on Aerospase end Electronic Systems, Vol. 34, Número 3, 1998, pp 817-823.

Spall, J.C., Introduction to Stochastic Search and Optimization Estimation., Simulation and Control, NJ, John Wiley & Sons, Hoboken, NJ. 2003.