International Journal of Statistics and Applications

p-ISSN: 2168-5193    e-ISSN: 2168-5215

2016;  6(6): 408-415

doi:10.5923/j.statistics.20160606.10

 

Permutation Approach in Obtaining Control Limits and Interpretation of out of Control Signals in Multivariate Control Charts

Ikpotokin O.1, Ishiekwene C. C.2

1Department of Mathematics and Statistics, Ambrose Alli University, Epoma, Nigeria

2Department of Mathematics, University of Benin, Benin City, Nigeria

Correspondence to: Ikpotokin O., Department of Mathematics and Statistics, Ambrose Alli University, Epoma, Nigeria.

Email:

Copyright © 2016 Scientific & Academic Publishing. All Rights Reserved.

This work is licensed under the Creative Commons Attribution International License (CC BY).
http://creativecommons.org/licenses/by/4.0/

Abstract

The use of multivariate control charts in manufacturing and service industries is often avoided because of the complexity in its development and interpretation of out of control signals. Most multivariate control charts require a specific distributional assumption to establish their control limits, but the bootstrap and permutation methods does not rely on such distributional assumption. Control limit obtain from the bootstrap method is approximate in nature while that of permutation is exact. This study introduces the permutation method in obtaining exact control limits as well as interpreting out of control signals in multivariate Hotelling’s T2 control charts. A performance study of the methods using empirical data sets shows that results from the proposed Permutation method when compared with other existing methods perform better in identifying out of control signal rather than stopping the entire processes.

Keywords: Exact control limits,Hotelling’s T2, out-of-control signals, Permutation p-values

Cite this paper: Ikpotokin O., Ishiekwene C. C., Permutation Approach in Obtaining Control Limits and Interpretation of out of Control Signals in Multivariate Control Charts, International Journal of Statistics and Applications, Vol. 6 No. 6, 2016, pp. 408-415. doi: 10.5923/j.statistics.20160606.10.

1. Introduction

An important part of statistical process control chart is the setting of control limits, which plays a major role in determining whether a given process is in control or not. Since control limits assists in establishing whether the observed data are statistically significant or not, any statistical method that will guarantee its proper computation should be developed and employed so that the desired false alarm rate (similar to probability of making Type 1 error) will be minimized or exactly [1]. When a control chart signals, process quality managers must initiate a search for the cause of the process disturbance. The standard practice is to plot univariate control charts on the individual quality characteristics.
However, the use of separate charts does not allow information about the correlation of variables to be utilized, hence the multivariate control chart [2]. One common method of constructing multivariate control charts is based on Hotelling’s T2 statistics [3-6]. Traditionally, control chart is based on the assumption that monitoring statistics follow some form of distributional assumption. The modern time practice is that this assumption is usually violated and a control limit obtained through this process may be inaccurate thereby increasing the rate of false alarms [7-9].
To address the problem of distributional assumption, univariate bootstrap control charts were introduced to obtain control limits [10-16]. Generally, univariate control charts involves the computations of one variable, and any decision based on these charts when two or more variables are involved can increase false alarm rate, hence the nonparametric multivariate control charts, such as the bootstrap method may provides better alternative [17-21]. Most of the nonparametric multivariate Hotelling's T2 control limit obtained in the literature is from the bootstrap method. However, the bootstrap method is approximate in nature since sampling is carried out with replacement. To reduce the problem of violating multivariate distributional assumption as well as avoiding the problem of approximation, this study proposed the permutation method so as to obtain exact control limit. The proposed permutation method is exact in nature because sampling is done without replacement.

2. Proposed Permutation Method in Obtaining Hotelling’s T2 Control Limit

To reduce abnormal behaviours when multivariate distributional assumption is violated as well as overcoming the problem of approximation [22, 1], the permutation procedure is proposed to obtain exact control limit. Suppose there are quality characteristics with set of observations as can be summarized in the variance covariance matrix below:
The permutation algorithm for setting exact Hotelling’s T2 control limit is given by the following Steps:
STEP 1. Compute Hotelling’s statistic with observations from a given dataset as:
STEP 2. Generate permutation sample from the initial statistics in Step 1 without replacement as:
STEP 3. Compute the control limits by taking B average of percentile values as:
(1)
STEP 4. Use the established control limit to monitor a new observation. That is, if the monitoring statistic of a new observation exceeds declare that specific observation as out of control.
For example, if there are there are ways of arrangements as follows:
From the arrangement above, there are possible terms and distinct terms and the procedure is obtained as follows:
1. Obtain ways each for the 1st column, i.e. for
2. Obtain way for each of the ways in 1st column to have 2nd column, i.e. for each of the 6 ways in 1st column
3. Obtain way for each of the 2ways in 2nd column to have 3rd column, i.e. way for each of the way in 2nd column.
4. Obtain way for each of the way in 3rd column to have 4th column, i.e. way for each of the way in 3rd column. Or complete the 4th (last) column by filling the value of that is yet to appear in each of the row.
5. Obtain 100(1-α) percentile for each row.
6. Obtain the permutation control limit by taking the average of the 100(1-α) percentile.

2.1. Proposed Permutation P-values Method in Identifying out of Control Signal

The problem of identifying quality characteristics that is responsible for an out of control signals has been an issue in multivariate control charts [23-30]. The introduced of Multivariate statistical process control charts based on the approximate sequential χ2 test to detect a change in the non-centrality parameter was by [31]. The skipping strategy to reduce the effect of the autocorrelation on the T2 chart’s performance was proposed by [32]. A very useful approach to the diagnosis of an out of control signal is to decompose the Hotelling’s statistic into components that reflect the contribution of each of the d-dimensional vector of quality characteristics [23]. The following Steps Modified [23] in identifying out of control signal in multivariate control chart.
STEP 1.
For a d-dimensional vector of quality characteristics, the first row is expressed as:
STEP 2.
Obtain the Critical Values from f-distribution for each of and terms in [23] such that:
and
are used to check whether the variable is conforming to the relationship with other variables or not.
STEP 3.
Repeat Steps 1 and 2 for other rows based on the number of quality characteristics (d!) and obtain the distinct terms (d*2d-1) for both the unconditional and conditional terms.
STEP 4.
Obtain the permutation p-values for each of and terms such that:
STEP 5.
Use the various in Step 4 to assess whether there is a significant difference or not. If value, it means that or is (are) not responsible for the out of control signal(s). But when value, it means that or is (are) responsible for the out of control signal(s).

3. Application to Numerical Example

By way of illustration, the set of data were obtained from the production processing of Owel Industries Nig. Ltd., a Family Delight Pure Soya Oil Production (FDPSOP) Company in Ekpoma, Edo State, Nigeria. Four quality characteristics (X1, X2, X3 and X4) representing phosphoric acid (milliliters), water (liters), caustic soda solution (kg) and industrial salt (kg) respectively at the neutralizer stage, under which forty five samples were recorded as shown in Columns (X1, X2, X3 and X4) of Table 1. The choice of data used in this study is the presence of sub standard product of cooking oil displayed in the local market in Nigeria. Another motivation is the challenges faced by Quality Control Managers to identify the variable that is responsible for out of control signals or stop the entire production process. Stopping the process will result to waste of material resources and continuing with the process without identifying the variable will lead to sub standard product. The urge to solve these problems gave rise to this research work.
Table 1. FDPSOP Data and
      Statistic
     

3.1. Test of Correlation Coefficient

To apply any multivariate control chart methodology, there is need to know whether there exists inter-correlation among the four quality characteristics. From the given data, the statistics of mean vector variance covariance matrix and correlation matrix are given as follows:
and
* Significant at 0.05 ** Significant at 0.01
The correlation matrix shows that there exists inter – correlation among the four quality characteristics, hence the need for multivariate control chart. The values of Hotelling’s statistic is computed for each sample and summarized in the last column of Table 1. The proposed permutation procedures presented in Session 2.0 was translated to Permutation Generic Code, permutation samples were replicated 13,948 times from the Hotelling’s statistic, and control limit is determined to be 10.0895 by taken the B average of 100(1-α) percentile value computed for each sample. Table 2 shows the results of control limits obtained from two existing methods (F-distribution and Phaladigalon’s [19]) with the proposed permutation methods at α = 0.05 level of significant and the control chart to monitor the observations is shown in Figure 1.
Table 2. Control Limits for the Different Methods at α Level of 0.05
     
Figure 1. Multivariate Hotelling’s T2 Control Chart for the given Data

3.2. Identification of Out of Control Signal by the Critical and P-values Methods

Table 2 and Figure 1 shows that samples 5, 7 and 16 are out of control, but we do not know which or set of quality characteristic(s) that is(are) responsible for the signals, hence the need to identify those quality characteristics by using the proposed p-values methods. To explain this procedure, focus shall be on Samples 5. Table 3 shows all the unconditional and conditional values computed for Sample 5 and compared with the various critical and p-values from both existing and proposed methods.
Table 3. Unconditional
      Terms with p-values (Number of
      in Parenthesis)
     

3.3. Discussion and Interpretation of Out of Control Results

Results in Table 2 shows that control limits obtained from both F-distribution and Phaladiganon’s methods where able to detect out of control signal for Samples 5 and 16, but consider Sample 7 to be under control. This has demonstrated the ability of both methods to detect large shift in the process mean vector. However, the proposed permutation method was able to detect out of control signals in additional one Sample (7), this has demonstrated the ability of the proposed method to detect shift better in any process. Table 3 shows all the unconditional and conditional values for Sample 5 that were computed and compared with their respective critical and p-values. From Table 3, of the four unconditional terms associated with Sample 5 are significant, which means (water in liters) and (industrial salt in kg) are responsible for the out of control signals individually. However, results from Phaladiganon’s p-values did not support this finding. This has further demonstrated the ability of the proposed method to performed better in setting control limits and identifying out of control signals over the existing method. To reduce the problem of out of control signal facing variables X2 and X4, remove separately from of Sample 5 and compare with the control limits whether they are significant or not. i.e.
Hence, we conclude that variable X2 is not significant. However, result obtain when is removed from shows that (industrial salt in kg) is significant when compared with Control Limits from the proposed methods in Table 2, hence we move to the next step, i.e.
In Table 4, the first conditional terms associated with Sample 5 shows that and of the twelve conditional terms have significant values, which means the relationship between (water) and (phosphoric acid); (water) and (caustic soda); (water) and (industrial salt); (industrial salt) and (phosphoric acid); (industrial salt) and (caustic soda) respectively are responsible for out of control signals. To reduced the problem of out of control signal facing these 1st conditional variables, remove and separately from of Sample 5 and compare with the control limits whether they are significant or not. are not significant as shown in the last columns of Table 5, while and are significant, hence we move to the next step, i.e.
A similar interpretation of results from Table 5 shows that and of the second conditional terms are significant, hence the last step in Table 6 shown no significant difference.
Table 4. 1st Conditional
      Terms with p-values (Number of
      in Parenthesis)
     
Table 5. 2nd Conditional
      Terms with p-values (Number of
      in Parenthesis)
     
Table 6. 3rd Conditional
      Terms with p-values (Number of
      in parenthesis)
     

4. Conclusions

This study specifically considered the permutation method as a means of determining exact Hotelling’s T2 control limits. Procedures that can carry out a systematic generation of permutation replications of two or more quality characteristics have been proposed in this work; it is straight forward but computer intensive. However, to identify the root cause of change when multivariate control charts signals, this work also considered the p-value method in identifying the variable(s) that is(are) responsible for the out of control signals. It is of importance to note that the univariate control chart practice is to stop the entire process as a result of out of control signal at variable X2 and X4, this will result to waste of material resources or low quality or sub standard products if the process continuous. With the proposed multivariate methods, one variable is being conditioned on the other(s) as shown in Table 3. The implication of these findings is the advantages of multivariate control charts; by combining variable X2 or X4 with any other variables until there is no out of control signals as observed in Table 6. This was achieved when variable X2 was combined with X1, X3 and X4 on one hand, and X4 with X1, X2, and X3 on the other hand. This finding will enhance production process and avoid waste of material resources and improve the quality of product.

References

[1]  Odiase, J.I. and Ogbonmwan, S.M. (2005). An algorithm for generating unconditional exact permutation distribution for a two-sample experiment. Journal of Modern Applied Statistical Methods. 4(1), 319-332.
[2]  Takemoto, Y. and Arizono, I. (2010). New Approach to Identifying Assignable Quality Characteristics in 2 Dimensional Hotelling T2 Control Chart. Proceedings of the Asia Pacific Industrial Engineering and Management Systems Conference.
[3]  Mason, R.L. and Young, J.C. (2002). Multivariate Statistical Process Control with Industrial Applications, ASA-Society for Industrial and Applied Mathematics, Philadelphia.
[4]  Hasssan, A, Baksh, M.S., Shaharoun, A.M and Jamaluddin, H. (2003). Improved SPC Chart Pattern Recongnition using Statistical Features. International Journal of Production Research; 41(7): 1587-1603.
[5]  Taleb, H., Limam, M. and Hirota, K. (2006). Multivariate Fuzzy Multinomial Control Charts, Quality Technology and Quantitative Management, 3(4): 437-453.
[6]  Park, J. H. and Jun, C. H. (2012). Multivariate process control chart for controlling the false discovering rate. Industrial Engineering & Management System, 11(4), 385 – 389.
[7]  Polansky, A.M. (2005). A general framework for constructing control charts. Quality and Reliability Engineering International, 21: 633-653.
[8]  Bersimis, S., Psarakis, S. and Panaretos, J. (2007). Multivariate Statistical Process Control Charts, Quality and Reliability Engineering International, 23: 517 – 543.
[9]  Edokpa, I.W, Ikpotokin, O and Erimafa, J.T. (2009). A Study of Average Run Length Distribution of an Exponentially Weighted Moving Average Control Chart. Journal of Mathematical Sciences, 20 (3):171- 179.
[10]  Ogbonmwan, S.M. and Odiase, J. (1992). Setting of Control Limits by the Bootstrap Method, Journal of Nigerian Statistical Association (JNSA), 8(2): 116-123.
[11]  Bajgier, S.M. (1992). The Use of Bootstrapping to Construct Limits on Control Charts. Proceedings of the Decision Science Institute, San Diego, CA, 1611-1613.
[12]  Vives-Mestres, M., Daunis-i-Estadella, J. and Martin-Fernandez, J.A. (2014). Out-of-Control signals in three-part compositional T2 control chart. Quality and Reliability Engineering International, 30(3): 337-346.
[13]  Liu, R.Y. and Tang, J. (1996). Control Charts for Dependent and Independent Measurements Based on the Bootstrap. Journal of American Statistical Association; 91(436): 1694-1700.
[14]  Jones, I.A. and Woodall, W.H. (1998). The Performance of Bootstrap Control Charts. Journal of Quality Technology; 30(4): 362-375.
[15]  Lio, Y.L. and Park, C. (2008). Bootstrap Control Chart for Birnbaum-Saunders Percentiles. Quality and Reliability Engineering International; 24(5): 585-600.
[16]  Park, H.I. (2009). Median Control Charts Based on Bootstrap Method. Communication in Statistics-Simulation and Computation, 38(1): 558-570.
[17]  Chou, Y.M., Manson, R.L. and Young, J.C. (2001). The Control Chart for Individual Observations from a Multivariate Non-normal Distribution. Communications in Statistics Simulation and Computation, 30(8-9), 1937-1949.
[18]  Chatterjee, S. and Qiu, P. (2009). Distribution-Free Cumulative Sum Control Charts using Bootstrap Based Control Limits. The Annals of Applied Statistics, 3(1): 349-369.
[19]  Phaladiganon, P., Kim, S.B., Chen, V.C.P., Baek, J.G. and Park S.K. (2011). Bootstrap Based T2 Multivariate Control Charts. Communication in Statistics-Simulation and Computation, 40(5): 645-662.
[20]  Adewara, J.A. and Adekeye, K.S. (2012). Bootstrap T2 Technique for Minimax Multivariate Control Chart. Open Journal of Statistics, 2: 469-473.
[21]  Ikpotokin, O. and Ishiekwene, C.C. (2014). Constructing Hotelling’s T2 Control Limits for Different α Levels of Significance. Journal of Applied Science and Technology, 19(1 & 2) 49-58.
[22]  Good, P. (2000). Permutation Tests: A practical guide to resampling methods for testing hypotheses, (2nd ed.) New York: Springer-Verlag.
[23]  Mason, R.L., Tracy, N. D. and Young, J.C. (1997). A Practical Approach for Interpreting Multivariate Control Chart Signals, Journal of Quality Technology, 29: 396-406.
[24]  Runger, G. C., Alt, F. B. and Montgomery, D. C. (1996). Contributors to a Multivariate Statistical Process Control Signal, Communication in Statistics: Theory and Methods, 25(10): 2203–2213.
[25]  Das, N. (2006), Multivariate Diagnostic Tests, a Review of Different Methods. economic Quality Control, 21(1): 143-153.
[26]  Guh, R. (2007), On Line Identification and Qualification of Mean Shifts in Bivariate Process using a Neural Network based Approach; Quality and Reliability Engineering International, 23(3): 367- 385.
[27]  Li, T., Hu, S., Wei, Z. and Liao, Z. (2013). A Framework for Diagnosing the out of Control Signals in Multivariate Process using Optimized Support Vector Machines. Mathematical Problems in Engineering in http://dx.doi.org/10.1155/2013/494626.
[28]  Seppala, T., Moskowitz, H., Plante, R., and Tang, J. (1995): Statistical Process Control via the Subgroup Bootstrap. Journal of Quality Technology, 27: 139-153.
[29]  Costa, F.S.L., Pedroza, R.H.P., Porto, D. L., Amorim, M.V.P., Lima. K.M.G. (2015). Multivariate Control Charts for Simultaneous Quality Monitoring of Isoniazid and Rifampicin in a Pharmaceutical Formulation Using a Portable Near Infrared Spectrometer. Journal of the Brazilian Chemical Society, 26(1): 64-73, http://dx.doi.org/10.5935/0103-5053.20140214.
[30]  Oyeyemi, G. M. (2011). Principal Component Chart for Multivariate Statistical Process Control, The Online Journal of Science and Technology, 1(2): 22-31.
[31]  Kim, J., Al-Khalifa, K.N., Jeong, M.K., Hamouda, A.M.S. and Elsayed, E.A. (2014). Multivariate statistical process control charts based on the approximate sequential χ2 test. International Journal of Production Research, 52, (18) 5514-5527 http://dx.doi.org/10.1080/00207543.2014.917212.
[32]  Leoni, R.C., Costa, A.F.B., and Franco, B.C. (2015). The skipping strategy to reduce the effect of the autocorrelation on the T2 chart’s performance. The International Journal of Advanced Manufacturing Technology, 80(9) 1547–1559 doi:10.1007/s00170-015-7095-1.