The Experimental Study on Verifying the Rationality and Weakness of THERP with an Example of Truck Refrigerant Filling Process
Received Date: Oct 27, 2017 / Accepted Date: Nov 07, 2017 / Published Date: Nov 15, 2017
With an example of truck refrigerant filling process, an experimental method by E-prime was used to verify the analysis of human error probability in the refrigerant filling process by The Technique of Human Error Rate Prediction (THERP). The result of the experiment is basically in coincidence with the result of THERP. The weakness of THERP is that it calculates the human error, ignoring the cognitive process of the operation behavior.
Keywords: Human error; THERP; Cognition process; Refrigerant filling; E-prime
There are many definitions of human error. From the view of engineering, the definition given by Swain is human behavior or action which exceeds the accepted standard or permissible scope of the normal work of the system . From the perspective of psychology, the definition given by Reason refers to human behavior deviated from the intended plan or procedure sequence, or human intention or action, not getting the desired result or reaching the intended target .
Human reliability refers to the probability that human successfully completes the task at any required stage of the system operation within the specified minimum time limit . The Technique of Human Error Rate Prediction (THERP)  is a widely used human reliability analysis method. THERP is a very powerful tool for analyzing the reliability of operators who perform testing or repairing tasks in existed procedures . Kirwan’s study indicated that the core problem of THERP is whether human error database and performance shaping factors (PSFs) can give the right result . Kirwan and Richard conducted an experimental study with 30 British participants to measure the probability of human error and the result indicated that THERP was effective . In another study, Kirwan explained the practical value of THERP from the perspective of reducing the probability of human error . Huang et al.  analyzed the application of THERP method in Chinese nuclear power plant with quantified method and explained the feasibility of THERP method . Tong et al.  studied the class factors of the application of THERP in nuclear power plants and gave some suggestions of improvement .
The research on human reliability analysis mainly focuses on nuclear power, aerospace or petrochemical fields [3,4,9,10]. In these areas, the rate of human error is very low, but it often leads to very serious production accidents. In truck manufacturing industry, there is few study on the application of the human reliability analysis. The present study applied experiment method to study one production process of truck manufacturing industry to verify the rationality and disadvantages of THERP.
The refrigerant filling process is an important process in the process of truck interior decoration in a certain enterprise, which influences the quality of the air conditioning of truck. According to the on-site investigation, the main operations of the refrigerant filling process includes connecting high-low pressure line of air conditioner with high-low pressure pipeline of filling machine, identifying type of air conditioner, choosing the filling quantity according to the type of air conditioner and pressing the button to fill. The refrigerant filling process relies on the main four operations to guarantee the completion of filling. Any errors in the process will result in the failure of the filling or quality problems, or even delay in truck production. The study focuses on the human error in the truck refrigerant filling process.
Analysis of the truck refrigerant filling process with THERP
THERP method makes task decomposition and analysis with human reliability analysis event tree, quantitatively calculates in accordance with human error data obtained from field experience and expert judgment, and amends with the performance shaping factors (PSFs), correlation and recovery factors. THERP method was used to analyze the human error of the truck interior refrigerant filling process. Figure 1 shows the HRA event tree diagram of the refrigerant filling process.
The symbols in Figure 1 are as follows
a: Operator succeeds in connecting high-low pressure line of air conditioner with
high-low pressure pipeline of filling machine
A: Operator fails to connect high-low pressure line of air conditioner with high-low
pressure pipeline of filling machine
b1: Operator correctly identifies the type of air conditioner
B1: Operator incorrectly identifies the type of air conditioner
b2: Operator successfully corrects the identification error
B2: Operator fails to correct the identification error
c: Operator correctly chooses the filling quantity
C: Operator incorrectly chooses the filling quantity
d: Operator successfully presses the button to fill
D: Operator fails to press the button to fill
S: Sequence of the operations
There are two considered conditions including task series and parallel connection. In task series connection, the probability of error is as follows:
In task parallel connection, the probability of error is as follows:
According to the data value range provided by the THERP manual , combining the enterprise field investigation and expert scoring, the K values of the PSFs were obtained as follows: operator experience K1=0, psychological pressure K2=0, human machine interface K3=0.44. Through quantitative calculation, the human error probability of each operation in the process of refrigerant filling was obtained as follows:
Operation 1 (connecting pipelines) P(F1)=4.32 × 10-3
Operation 2 (identifying type of air conditioner) P(F2)=7.77 × 10-4
Operation 3 (choosing the filling quantity) P(F3)=1.39 × 10-2
Operation 4 (pressing the button to fill) P(F4)=1.08 × 10-3
In the truck refrigerant filling process, human cognitive process is the most important. First, operator needs to identify different color pipelines belong to high pressure pipeline or low pressure before connecting pipelines. Second, operator must pay attention to the air conditioner nameplate and identify the air conditioner brand or manufacturer. Third, operator must store the information of the matching relation between air conditioning type and truck type in the brain, then transfer the stored information and respond to choose the correct filling quantity. Fourth, operator needs to identify the opening or closing button before pressing. The error probability of cognition process is the core factor in the whole filling process. In order to simulate the four cognition processes, one experiment is designed below.
Forty-eight voluntary participants (25 men and 23 women) were recruited at Xi’an Jiaotong University for this experiment. They were informed of the objectives and details of the study and gave informed consent before the experiment commenced. They are all in good health and have normal vision or corrective vision.
Instrument and materials
One Lenovo notebook computer with good button function was used. E-prime experimental design software was applied. The experimental materials were displayed by E-prime, mainly including pictures of black color pipeline and coffee color pipeline, pictures of nameplates of six different types of air conditioners and pictures of buttons of “on” and “off”.
Four experimental tasks were assigned to the participants. Task 1 was to identify pipelines with black and coffee color. Task 2 was to identify the type of air conditioner according to the nameplate. Task 3 was to choose the corresponding number according to the air conditioner nameplate. Task 4 was to identify the button of “open” or “off”. For each operation, there was a cognitive task that corresponded to a picture. During the experiment, a picture was randomly sampled from the corresponding picture library and displayed to the participant.
Before formal test, participants were familiar with the computer and the experimental materials. They learned to operate with buttons based on the printed experiment instruction. Then they began to perform the four experimental tasks in sequence of task 1, task 2, task 3 and task 4. Each participant needed to do this for twenty times. The operation errors of all the participants were automatically recorded.
The average error rate of participants was calculated. Table 1 shows the average error rate and correct rate of participants. The result indicated that task 3 had the highest error probability, followed by task 1, task 2 and task 4.
|Task||Average error rate||Average correct rate|
Table 1: The average error rate and correct rate of participants.
The data were analyzed using Analysis of Variance (ANOVA) with SPSS19. The result indicated that task 3 was significant (p<0.05) higher than task 1. Task 3 was also significant higher than task 2 (p<0.05) and task 4 (p<0.01). Task 1 was significant (p<0.05) higher than task 4. There was no significant difference between task 1 and task 2, task 2 and task 4.
From the experiment data, the human error probability in descending order was task 3, task 1, task 2 and task 4. Using THERP method, the descending order of the human error probability was also task 3, task 1, task 2 and task 4. Choosing the filling quantity and connecting pipelines had higher human error probability. Identifying type of air conditioner and pressing button to fill had lower human error probability. The difference of the results of two methods is that the values are much different. For example, the average error rate of task 1 in the experiment was 0.077, but the error rate of task 1 calculated by THERP was 0.00432.
In experiment, the error rate of task 1 was significant higher than that of task 4, but the difference in the result of THERP is not obvious. In the result of THERP, the error probability of task 1 and task 2 are very low, close to 0. THERP method has some weakness, such as, THERP method is mainly used in simple operations for the process and action analysis, without considering the cognitive process during operation. Especially for operations involving simple cognitive processes, the THERP method tends to ignore the cognitive process. In task 1, which is a more complex and complete information processing process, participant paid attention to color from one picture, stored and analyzed the vision sense of color, then compared with long term memory encoding , made decisions to press button in the end.
In task 2 and task 4, the long memory encoding only corresponded to text and button, such as “K” meant “open”, “T” meant “Ted” (one type of air conditioner), and so on. The corresponding relationship between these words and letters are Chinese characters and the first Chinese phonetic alphabet of the characters. All participants remembered the information of the corresponding relation having more than ten years of repeated encoding, and better effect in long term memory. The correspondence in task 1 was a new correspondence, and there was no other relation between texts and letters. Obviously, the cognitive process of task 1 was more complex than task 2 and task 4. This illustrated that why the error rate of task 1 in the experiment was higher than task 2 and task 4, and why task 2 and task 4 differed slightly in error rate.
Overall, the experimental results are basically consistent with the THERP method, and there are some differences in absolute value. This verifies the rationality of the THERP method.
In the present study, the method of E-prime experiment was used and compared with the THERP method to analyze the human error probability in truck interior refrigerant filling process. The results are basically similar, which verifies the rationality of the THERP method. This is the same as the results of Kirwan and Richard . The present study indicated that the weakness of THERP is that the cognitive process of behavior is ignored when calculating human errors.
The cognitive model has been widely applied in the human reliability technology, for example Jiang and Sun analyzed the typical cognitive model and its application of human factors reliability analysis, and indicated that cognitive models have become the most effective tool to explain the mechanism of human error . Most of the existed researches on THERP are based on the nuclear power industry [9,10]. This paper takes the truck manufacturing industry as the research background, analyzes and verifies the application of THERP method in the truck refrigerant filling process. In future study, some other reliability analysis methods can be analyzed and validated based on the cognitive model in truck industry.
This work was supported by the [Doctoral Research Start Foundation of Shaanxi University of Science and Technology] under Grant [number BJ15-36].
No potential conflict of interest was reported by the authors.
- Swain D, Guttmann HE (1983) Handbook of human-reliability analysis with emphasis on nuclear power plant applications. NUREG/CR-1278.
- Reason J (1990) Human Error. UK, Cambridge: Cambridge university Press.
- Alvarengaa M, Melob PF, Fonsecaa RA (2014) A critical review of methods and models for evaluating organizational factors in Human Reliability Analysis. Progress in Nuclear Energy 75: 25-41.
- Abbassi R, Khana F, Garaniyaa V, Chai S, Chin C, et al. (2015) An integrated method for human error probability assessment during the maintenance of offshore facilities. Process Safety and Environmental Protection 94: 172-179.
- Shirley R, Smidts C, Li M, Gupta A (2015) Validating THERP: Assessing the scope of a full-scale validation of the Technique for Human Error Rate Prediction. Annals of Nuclear Energy 77: 194-211.
- Kirwan B (1996) The validation of three Human Reliablity Quantification techniques-THREP, HEART and JHEDI: Part 1-technique descriptions and validation issues. Applied Ergonomics 27: 359-373.
- Kirwan B, Richard C (1997) The validation of three Human Reliablity Quantification techniques-THREP, HEART and JHEDI: Part 2-Results of validation exercise. Applied Ergonomics 28: 17-25.
- Kirwan B (1997) The validation of three Human Reliablity Quantification techniques-THREP, HEART and JHEDI: Part 3-Practical aspects of the usage of the techniques. Applied Ergonomics 28: 27-39.
- Shu-Dong H, Li-Cao D, Li Z (2006) Quantitative analysis and application of human reliability in nuclear power plant. Industrial Engineering and Management 2: 48-51.
- Jie-Juan T, Shao-Jie Y, Jun Z (2010) Team factors in the reliability analysis method THERP of nuclear power plant personnel. Journal of Tsinghua University (Natural Science Edition) 50: 1425-1428.
- Lin-Yan S (2008) Human Factors. Bei Jing: Higher Education Press p: 97.
- Yin-Jie J, Zhi-Qiang S (2011) A review of typical cognitive model and its application in the analysis of human reliability. Journal of safety and environment 11: 197-201.
Citation: Ming-Ming D, Guo-Qi Z (2017) The Experimental Study on Verifying the Rationality and Weakness of THERP with an Example of Truck Refrigerant Filling Process. J Health Educ Res Dev 5: 236. DOI: 10.4172/2380-5439.1000236
Copyright: © 2017 Ming-Ming D, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Select your language of interest to view the total content in your interested language
Share This Article
- Total views: 974
- [From(publication date): 0-2017 - Dec 19, 2018]
- Breakdown by view type
- HTML page views: 926
- PDF downloads: 48