Issue 
EPJ Nuclear Sci. Technol.
Volume 6, 2020



Article Number  57  
Number of page(s)  12  
DOI  https://doi.org/10.1051/epjn/2020019  
Published online  10 November 2020 
https://doi.org/10.1051/epjn/2020019
Regular Article
Empirical estimation of uncertainties of Charpy impact testing transition temperatures for an RPV steel
Université ParisSaclay, CEA, Service de Recherches Métallurgiques Appliquées, 91191 GifsurYvette, France
^{*} email: Bernard.Marini@cea.fr
Received:
28
April
2020
Received in final form:
21
August
2020
Accepted:
16
October
2020
Published online: 10 November 2020
The aim of the present work is to derive empirically a simple expression of the uncertainties on Charpy transition temperatures (TT), which depends only on the test temperatures and the number of tests at each of these temperatures. Calculations of the TT uncertainties of a RPV steel are performed based on an empirical representation of Charpy test results and a Monte Carlo procedure to generate large numbers of data sets for different test matrices. Applying usual procedures to determine the TT to the generated data sets gives access to the distributions of these quantities from which the uncertainties are calculated.An analytical expression for these uncertainties is proposed.
© B. Marini, published by EDP Sciences, 2020
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
1 Introduction
Because of its simplicity and robustness, Charpy impact testing is widely used to evaluate the toughness of structural steels from acceptance tests to ageing monitoring. Minimum values of fracture energy at reference temperatures is used for acceptance tests but inserviceageing monitoring requires determination of temperatures corresponding to conventional levels of fracture energy. For nuclear application of ferritic steels, the conventional levels are 28 J, 41 J and 68 J; the 56 J level is also used in France specifically in case of neutron irradiation [1]. These levels of energy are in the transition temperature domain where the fracture energy increases rapidly with temperature. The corresponding temperatures are called “transition” temperatures (TT). In addition, the fracture energy in the temperature domain corresponding to the ductile behaviour of the steel is also used and called the upper shelf energy (USE). Ageing of steels during operation could possibly modifythe transition temperatures, as well as the upper shelf energy. These shifts are measures of the embrittlement of the material and must be carefully determined to assess the ability of a component to fulfil its function in operating or accidental conditions. Therefore, the knowledge of the uncertainties in the determination of the transition temperatures and upper shelf energy is of the utmost importance for safe operations.
Uncertainties and confidence intervals on the transition temperatures could be estimatedfrom the statistics of the parameters of the fit function and are dependant of the dataset [2–5]. This means that, in this case, the uncertainties are not related only to the methodology of measure but also to the result of the measure itself. The aim of the present work is to derive a simple expression of the uncertainties on transition temperatures, which depends only on the test matrix defined by the test temperatures and the number of tests for each of these temperatures. In order to define this expression, estimations of the TT uncertainties of a representative 16MND5 type RPV steel are performed considering different test matrices. These evaluations are based on an empirical representation of Charpy test results and a Monte Carlo procedure to generate large numbers of data sets for different test matrices. Applying usual procedures to determine the TT to the generated data sets gives access to the distributions of these quantities from which the uncertainties are calculated.
2 Material and data base
The material is taken at ¾ thickness of a nozzle cutoff of a shell supporting the pipes of the primary circuit. The location of the sampling is outside of the macrosegregated zone and reduces the risk to intercept ghost lines in Charpy specimens. Therefore, the present evaluation of uncertainty does not consider macrosegregation or ghost lines induced scatter but lower scales heterogeneities (microsegregations, manganese sulphides,...) are taken into account through the use of the representative Charpy data. Uncertainties relative to specimen preparation and test machine are also included in this analysis.
The material fabrication processes as well as its chemical composition (Tab. 1) satisfy the RCCM specificationsfor 16MND5 heavy forgings [6]. The heat treatments of the shell after forging are performed to avoid the formation of hydrogen flakes, to homogenize the material and refine the grain size. The last quench is followed by a tempering and a stress relief heat treatment. The microstructure is a granular bainite with few percent of proeutectoid ferrite.
Metallurgical and mechanical characterizations of the material have been mainly obtained during three PhD thesis [7–9] but were later completed for this study. Charpy specimens were machined in LS orientation. 142 tests results are available in the temperature range [‑196, +300 °C] (Fig. 1). The transition curve of the fracture energy KV is described by a hyperbolic tangent function parametrized by the least squared method:(1)where USE is the upper shelf energy, T _{ t } is the transition temperature at 0.5 USE and T _{ hw } is the half width of the transition domain.
Table 2 presents the conventional transition temperatures and upper shelf values. We define the transition temperature range as the temperature interval between T28 and T68, i.e. approximatively [‑50, ‑20 °C]. This interval will be used to evaluate the position of the test matrices on the temperature axis.
Chemical composition of the material.
Fig. 1
Charpy test results and transition curve. 
Conventional transition temperatures and upper shelf.
3 Numerical simulation of the uncertainty
The simulation of the uncertainties of a given test matrix is based on a Monte Carlo method applied to an analytical representation of the data base.
3.1 Representation of the data
Because of the unbalanced number of results for the different test temperatures, an analytic description of the database is used instead of the individual values. The Charpy fracture energies are usually assumed to obey a Weibull distribution in the lower part of the transition region [10–13]. However, it is known that the standard deviation of the fracture energy goes through a maximum, approximatively at T _{ t }, associated with the possible development of a bimodality. Therefore, we choose here to use bimodal distributions to represent the variation of the data independently at each test temperature. These distributions result from the mixing of two Weibull distributions:(2)
At the test temperature T, γ is the fraction of the specimens failing with a “low” energy, E _{ l }, m _{ l } are the parameters of the distribution of the fracture energy E _{ f } for the specimens failing with low energy and E _{ h }, m _{ h } are the parameters for the specimens failing with higher energy. Low and high are relative to the meanvalue of the fracture energy at the considered test temperature. The values of the parameters γ, E _{ l }, m _{ l }, E _{ h }, m _{ h } are adjusted independently for each temperature (Fig. 2a). Linear interpolations between experimental temperatures are performed if needed for the test matrix (Fig. 2b). The distribution of fracture energy on the lower shelf region [‑196, ‑100 °C] is assumed to be temperature independent and all data are considered to belong to the same distribution. The same assumption is made for data on the upper shelf [+60, +300 °C].
In the transition region, the mixing law gives a satisfactory description of the data. It could be noted that the ductile crack propagation before cleavage fracture which appears typically above 50 J for this RPV steel, could give a clue to explain the shape of the fracture energy distributions. However, there is no simple correlation between equation (2) and the fracture initiation and propagation modes. Consequently, in the present work, no physical meaning is claimed for equation (2) which allows a simple and flexible description of the data base.
Fig. 2
Data base from lower shelf (T < ‑100 °C) to upper shelf (T > 50 °C). (a) Fittings of equation (1) at different temperatures. (b) Data distributions for the modelling of uncertainties. The parts of these distributions below 5% and above 95% (grey zones) are not used in the modelling of uncertainties. 
3.2 Simulation procedure
The numerical procedure aim is to simulate a large number of determinations of the TT allowing the study of their distributions for a given test matrix. It is based on a simple random sampling with replacement applied of the distributions defined by equation (2). The evaluation of the quantities needed to evaluate the uncertainties on transition temperatures associated to a chosen test matrix is obtained through the following procedure:

Step 1: Monte Carlo method is used to obtain a set of data from equation (2) according to the test matrix under evaluation. To avoid unrealistic values, only data corresponding to a probability in the interval [0,05, 0,95] are retained.

Step 2: The transition temperatures T28, T41, T56 and T68 are determined froma hyperbolic tangent function (Eq. (1)) parametrized by least squares method on the data set obtained in step 1.

Steps 1 and 2 are repeated 10000 times thanks to an Octave script [14].

Then the transition temperatures are statistically characterized through their mean, standard deviation and other statistical characteristics of their distributions.
Two quantities are considered to derive the uncertainty: the precision and the accuracy. The precision σ is quantified by the standard deviation of the mean value of T28, T41, T56, T68 and USE of the sampled data set. The accuracy (or error) ϵ is the difference between the true values and computed values of transition temperaturesmeans; i.e., the mean value of T28, T41, T56, T68 and USE derived from resampled data points, which follows equation (2). Therefore, the uncertainty u of a transition temperature T _{ k } is the sum in quadrature of these two quantities:(3)
3.3 Assessment of the simulation
The test matrix of the database is used to assess the simulation procedure. For this assessment, the “true” values of transition temperatures and upper shelf used to compute the accuracy e are here the values obtained from the fitting of the database (Tab. 2).
Table 3 and Figure 3 present the results of the 10,000 computations of transition temperatures and upper shelf with the test matrix of the database. The mode of sampled transition temperatures is close to these obtained by overall data base: for the transition temperatures, the accuracy values are smaller than the standard deviation. The main part of uncertainty on transition temperatures comes from the precision which is primally in relation with the data scatter in the transition domain. We assume that the accuracy values are small enough compared to usual experimental errors to conclude that the simulation procedure is satisfactory.
Mean, precision and accuracy obtained from 10 000 data sets with the test matrix of the database.
Fig. 3
Comparison of the computed distributions (circles) with thedata base values (dotted lines). Class size is 0.5 °C for TT and 0.5J for USE. 
3.4 Definition of the reference case
The determination of the accuracy needs the definition of a reference case with “true” values of transition temperatures and upper shelf. The database values cannot be considered as true because of the size of the population and the imperfections in its modelling. So, we have defined “true” values as the results of the simulation with a test matrix with a large number of specimens (600) distributed on 7 test temperatures between ‑90 and +100 °C (Tab. 4). We assume that the values resulting of the simulations with this test matrix (Tab. 5) are the true values from which the accuracy of the other test matrices is evaluated. As the reference case represents the “truth”, its accuracy is equal to 0 and its uncertainty is equal to its precision. It is interesting to note that the skewness and Kurtosis coefficient indicate that the transition temperatures and, to a less extent, the upper shelves distributions are nearly symmetric and mesokurtic. As shown in Figure 4, these distributions can befairly described with normal distributions of the computed means and standard deviations.
Test matrix of the Reference Case (RC).
Mean, precision, skewness and Kurtosis coefficient of the distributions for the Reference Case.
Fig. 4
Comparison of the computed distributions (circles) with the normal distributions of the same mean and standard deviation (solid lines). Class size of the computed distributions is 0.25 °C or 0.25J. 
3.5 Repeatability of uncertainty evaluation
Because of the high variability of the fracture energy in the transition regime, test matrices with a realistic number of specimens (typically 12‑30) will lead to significant fluctuations of the transition temperatures. Even with 10,000 sets of data, some variation of the mean values and other characteristics could be expected. We have checked these variations on a test matrix built in agreement with the codification (MC1222 “Tracé de la courbe de transition” from [6]). The test matrix is composed of 18 tests: 3 on the upper shelf (+100 °C) and 15 in the transition region (Tab. 6).
The results of a first run with the “RCCM” test matrix are presented in Table 7 and Figure 5. Compared to the reference case (RC), the precision is loweras expected. However, the accuracy of the test matrix is s satisfactory when compared, on one hand, to measurement uncertainties and, on the other hand, to application needs. Consequently, the uncertainties are mainly due to the lack of precision related to the number of specimens. One can note that the used test matrix leads to a low uncertainty for T56 and a higher for T28, T41 and T68 have almost the same intermediate uncertainties. The skewness and Kurtosis coefficients of T28 and USE distributions indicate a derivation from symmetry and mesokurticity which can be seen by comparing these distributions with the normal ones (Fig. 5).
Ten runs of the modelling procedure were successively performed for this test matrix. The different values of the transition temperatures and upper shelf as well as the associated uncertainties are shown in Figure 6. The results are remarkably reproductible and the maximum difference between uncertainties varies from 0.08 to 0.05°C for the transition temperatures and is equal to 0.16 J for the USE. Assuming a Student distribution of the means, the confidence interval at 99.9% is 0.05 °C for TT and 0.08J for USE. So,in the context of these simulations, we consider that differences of uncertainties are significant, if they are equal or greater than 0.1°C for transition temperatures and 0.2J for USE.
The “RCCM” test matrix.
Mean, precision, skewness and Kurtosis coefficient of the distributions for the “RCCM” test matrix.
Fig. 5
Comparison of the computed distributions (circles) with the normal distributions of the same mean and standard deviation (solid lines) and the reference case values (vertical dotted lines). Class size is 1°C or 1J. 
Fig. 6
Transition temperatures and associated uncertainties for the 10 runs using the RCCM test matrix. 
4 Results
4.1 Effect of the position of the test matrix on the transition temperatures uncertainties
The number of specimens can be limited due to the available material quantities or the room in thermal or irradiation ageing devices. In these cases, the position of the test matrix with respect to the transition region could be of importance. In the following, we consider that we have 15, 20 or 25 specimens to determine as well as possible (i.e. with the lowest uncertainty) the transition temperatures. We choose to put 3 specimens to define the upper shelf and the remaining specimens in or around the transition temperaturesdomain. The step of test temperatures is 20 °C. The chosen test matrices are named ANk, where N ∈ {15, 20, 25} isthe total number of specimens and k is the case number ∈ {1 to 11} (Tab. 8).
In order to rationalize the results, we introduce the “shift of the test matrix” S with respect to the transition temperatures region:(4)where N is the number of specimens,nT is the number of test temperatures, w _{ i } is the weight associated with the test temperature i and n _{ i } is the number of tests performed at this temperature.
The weight of the tests in the transition temperatures domain defined by the interval [T28, T68] is equal to zero. Negative or positive weights are attributed to test temperatures, respectively, below or above the transition temperatures domain. Test temperature of −20°C is considered to be for half in the transition temperature range, then the weight of this temperature is +0.5. With these assumptions, the shifts of the test matrices A range from −0.23 up to 1.33 (Tab. 8).
The results of the uncertainty evaluation pro cedure applied to these test matrices are presented in Figure 7.
The dependences of uncertainties on TT on the shift are described by parabolic functions (Figs. 7a–7d). The minimum of uncertainties on the different TT is not reached for the same shift value; the higher the reference energy is, the higher is the optimum shift. The uncertainty evolutions for 15 and 20 specimens are tangent close to the minima of uncertainty; 25 specimens are needed to clearly reduce these minima and improve the uncertainty on the entire shift domain.
Test matrices with 15, 20 and 25 specimens. N is the total number of tests and nT is the number of test temperatures.
Fig. 7
Evolution of the uncertainties against the test matrix shift. The dotted lines are linear or parabolic fits of the uncertainties corresponding to test matrices A with 15, 20 or 25 specimens. 
4.2 Effect of the number of specimens on the transition temperatures uncertainties
The uncertainty dependence on the number of specimens was studied on two sets of test matrices. The matrices of the first set are named “Bi” where “i ” is the number of specimens per test temperature varying from 2 to 20 (Tab. 9). The number of test temperatures is 5 and the total number of specimens is 5.i. Of course, using a large number of specimens on the upper shelf is somewhat unrealistic but permits to maintain a constant test matrix shift when increasing the specimen number. One can note that the test matrix B3 is identical to matrix A52.
The results of the calculation using Bi matrices are presented in Figure 8. Uncertainty and precision are decreasing rapidly with the number of specimens in the transition temperature region.T41 and T56 uncertainties are nearly the same. Accuracies of transition temperatures are almost independent on the number of specimens and tend toward different values between −1 and 1°C and does not significantly affect the dependence on the number of specimens. This behaviour is probably in relation with the fair distribution of test temperature in the transition region. Skewness and excess Kurtosis coefficients tends to zero for large number of specimens indicating a trend toward normal distribution. The T41 transition temperature is almost normally distributed even for small number of specimens.
Uncertainties evolution with the number of specimens is well fitted by a power law function (Fig. 8b):(5)
Table 10 gives the values of the coefficients. It appears that the transition temperatures uncertainties are almost inversely proportional to the squared root of the number of specimens.
The second study of the dependence of the uncertainties on the number of specimens was conducted on matrices defined in Table 11. They are named “Ci” where “i ” is the number of specimens for some of the test temperatures. The number of specimens on the upper shelf is constant and equal to 3 for all the matrices. The number of test temperatures is 6 and the total number of specimens of test matrix Bi is 5.i.
The uncertainties of matrices Ci appear to be smaller than these of matrices Bi (Fig. 9). This is mostly because 5.i 3 specimens are used, here, to define the transition region instead of 4.i in the case of the matrices Bi.However, an effect of the shift,which is not constant, is also possible.As for the Bi matrices, skewness and excess Kurtosis coefficients tends here to zero for large number of specimens indicating a trend toward normal distribution. The T28 and T41 transition temperatures are almost normally distributed even for small number of specimens.
As for matrices Bi, uncertainties evolution with the number of specimens is well fitted by a power law function equation (5). The coefficients obtained are given in Table 12. The transition temperatures uncertainties evolution against the specimen number is slightly faster than for the matrices B for the same reasons mentioned above.
Test matrices with i specimens (2 ≤ i ≤ 20).
Fig. 8
Evolutions of uncertainties precisions, accuracies, skewness and excess Kurtosis coefficients with the number of specimens for test matrices Bi. 
4.3 Evaluation of the uncertainty from the matrix shift and the number of specimens
From the previous results, an expression of the uncertainties of transition temperatures as function of the matrix shift and of the total number of specimens of the matrix can be proposed.
In order to have a simple relationship, we assume that the uncertainties are inversely proportional to the squared root of the number of specimens, i.e. we set the exponent β of equation (5) to 0.5. The amplitude α of this equation is assumed to be a parabolic function of the test matrix shift. So, the uncertainties u of transition temperature T _{ k } is given by:(6)
The coefficients a_{k} ,b_{k} and c_{k} are tuned on the results of the simulations with the matrices A, B and C (solid lines in Figure 10). The values of these parameters are given in Table 13. An upper bound of the uncertainties on each transition temperature is defined by increasing the parameter c_{k} in such a way that the data corresponding to the highest uncertainty amplitude α _{ k } is on the parabolic function plot (dotted lines in Fig. 10). The values of the corresponding c_{k} parameters (c_{k} upper bound) are also given in Table 13.
Equation (6) can be checked by applying it to previous simulation results not used for the parameters tuning. We have taken the case of the first run for the “RCCM” matrix which have a test matrix shift of 0.67. The uncertainties given by equation (6) and of the simulation are found to be in good agreement (Tab. 14).
Fig. 9
Evolutions of uncertainties precisions, accuracies, skewness and excess Kurtosis coefficients with the number of specimens for test matrices Ci. 
Fig. 10
Uncertainty amplitude variations with the test matrix shift. 
Test matrices C2 and Ci with i specimens (2 ≤ i ≤ 20).
Values of the coefficients of the uncertainty amplitudes (°C).
5 Conclusions
Distributions of transition temperaturesT28, T41, T56 and T68 have been determined using numerical simulations based on a random sampling of Charpy data. Uncertainties on these transition temperatures have been derived, for different test matrices, from the standard deviation and the error from reference values obtained thanks to a simulation with a very large number of specimens (600).
The main conclusions of this study are:

For large numbers of specimens (N > 30), distributions of TT are well described by the normal distribution of same mean and standard deviation.

For smaller numbers, distributions could be slightly asymmetric and more peaked than the normal distribution.

The position of the test matrix relatively to the transition temperatures range had an impact on the uncertainties. This impact is not the same for the different TT.

T41 and T56 uncertainties appears to be smaller and less sensitive to the test matrix than these of T28 and T68.

Uncertainties are approximatively inversely proportional to the squared root of the number of specimens.

An empirical equation to estimate the uncertainties is proposed. It is a function of the number of specimen and of the shift of the test matrix.
Acknowledgments
This work was partly funded by SOTERIA, a project of the European Union's Horizon 2020 research and innovation programme. The author thanks all the contributors to the database and, in particular, the members of the fracture mechanics laboratory of the SRMA at CEA Saclay.
References
 P. Todeschini, Y. Lefebvre, H. ChurierBossennecn, N. Rupa, G. Chas, C. Benhamou, Proceedings of Fontevraud 7, 230 September 2010, Paper A084T01 [Google Scholar]
 F.W. Stallman, Proceedings of 4^{th} ASTMEuratom Symposium on Reactor Dosimetry, Larch 22–26 (1982) [Google Scholar]
 C. Brillaud, H. Augendre, M. Bethmont, Proceedings of Effect of irradiation on Materials: 17^{th} International Symposium, ASTM STP 1270, 375–383 (1996) [Google Scholar]
 R. Moskovic, P.E.J. Flewitt, Metallurgical and Materials Transactions A 28A, 2609–2623 (1997) [CrossRef] [Google Scholar]
 M.T. Todinov, Materials Science and Engineering, A265, 1–6 (1999) [Google Scholar]
 AFCEN, RCCM Code (2017) [Google Scholar]
 S. Renevey, PhD Thesis, CEAR5784 (1998) [Google Scholar]
 A. Rossol, PhD Thesis, EC P 98–43 (1998) [Google Scholar]
 S. Carassou, PhD Thesis, CEAR5886, (2000) [Google Scholar]
 D.J. Downing, F.M. Haggag, R.K. Nanstad, Int. J. Pres. Ves. & Piping 44, 241–254 (1990) [CrossRef] [Google Scholar]
 B. Strnadel, P. Hausild, Materials Science and Engineering A 486, 208–214 (2008) [CrossRef] [Google Scholar]
 Y. Takashima, M. Ohata, F. Minami, Materials Science Forum Vols. 783786, 2394–2399 (2014) [Google Scholar]
 S. Pillot, P. Pacqueau, Engineering Fracture Mechanics 135, 259–273 (2015) [CrossRef] [Google Scholar]
 J.W. Eaton, D. Bateman, S. Hauberg, R. Wehbring, GNU Octave version 5.2.0 manual: a highlevel interactive language for numerical computations, (2020), URL https://www.gnu.org/software/octave/doc/v5.2.0/ [Google Scholar]
Cite this article as: Bernard Marini, Empirical estimation of uncertainties of Charpy impact testing transition temperatures for an RPV steel, EPJ Nuclear Sci. Technol. 6, 57 (2020)
All Tables
Mean, precision and accuracy obtained from 10 000 data sets with the test matrix of the database.
Mean, precision, skewness and Kurtosis coefficient of the distributions for the Reference Case.
Mean, precision, skewness and Kurtosis coefficient of the distributions for the “RCCM” test matrix.
Test matrices with 15, 20 and 25 specimens. N is the total number of tests and nT is the number of test temperatures.
All Figures
Fig. 1
Charpy test results and transition curve. 

In the text 
Fig. 2
Data base from lower shelf (T < ‑100 °C) to upper shelf (T > 50 °C). (a) Fittings of equation (1) at different temperatures. (b) Data distributions for the modelling of uncertainties. The parts of these distributions below 5% and above 95% (grey zones) are not used in the modelling of uncertainties. 

In the text 
Fig. 3
Comparison of the computed distributions (circles) with thedata base values (dotted lines). Class size is 0.5 °C for TT and 0.5J for USE. 

In the text 
Fig. 4
Comparison of the computed distributions (circles) with the normal distributions of the same mean and standard deviation (solid lines). Class size of the computed distributions is 0.25 °C or 0.25J. 

In the text 
Fig. 5
Comparison of the computed distributions (circles) with the normal distributions of the same mean and standard deviation (solid lines) and the reference case values (vertical dotted lines). Class size is 1°C or 1J. 

In the text 
Fig. 6
Transition temperatures and associated uncertainties for the 10 runs using the RCCM test matrix. 

In the text 
Fig. 7
Evolution of the uncertainties against the test matrix shift. The dotted lines are linear or parabolic fits of the uncertainties corresponding to test matrices A with 15, 20 or 25 specimens. 

In the text 
Fig. 8
Evolutions of uncertainties precisions, accuracies, skewness and excess Kurtosis coefficients with the number of specimens for test matrices Bi. 

In the text 
Fig. 9
Evolutions of uncertainties precisions, accuracies, skewness and excess Kurtosis coefficients with the number of specimens for test matrices Ci. 

In the text 
Fig. 10
Uncertainty amplitude variations with the test matrix shift. 

In the text 
Current usage metrics show cumulative count of Article Views (fulltext article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 4896 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.