EPJ Nuclear Sci. Technol.
Volume 4, 2018
Special Issue on 4th International Workshop on Nuclear Data Covariances, October 2–6, 2017, Aix en Provence, France – CW2017
|Number of page(s)||10|
|Section||Nuclear Data Library|
|Published online||14 November 2018|
Checking, processing and verification of nuclear data covariances
* e-mail: firstname.lastname@example.org
Received in final form: 17 January 2018
Accepted: 14 May 2018
Published online: 14 November 2018
The aim of this paper is to present the activities carried out by NEA Data Bank on checking, processing and verification of JEFF-3.3T4 covariances. A picture of the completeness and status of the JEFF-3.3T4 covariances is addressed. The verification of JEFF-3.3T4 covariances is performed with nuclear data sensitivity tool providing the keff uncertainty as a function of the contributing nuclide-reaction pairings including cross-reaction covariances. A total number of 4501 ICSBEP benchmarks is used in this analysis. This exercise is also extended to covariance libraries such as JENDL-4.0 updated files, ENDF/B-VII.1, SCALE-6.2rev8 and ENDF/B-VIII.0β5, allowing comparison of these results with both the experimental criticality benchmark and different methodologies of evaluation.
© O. Cabellos et al., published by EDP Sciences, 2018
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
JEFF-3.3T4  is a fully consistent and complete nuclear data library with all data needed and associated covariance information (full covariance information for the main actinides), which can be reliably used for a large spectrum of applications, and which has shown a better performance than JEFF-3.2 library . Previous work carried out by NEA Data Bank on checking, processing and verification of earlier JEFF-3.3 beta releases has been presented in past JEFF meetings [3,4]. In this paper, the efforts of NEA Data Bank focused on the latest beta JEFF-3.3T4 release are presented. A review of NEA tools and databases is described in Section 2.
In Section 3, we have performed a comparison of relative standard deviation and correlation matrix with major covariance nuclear data libraries such as ENDF/B-VII.1 , JENDL-4.0u1 , SCALE6.2  and the recent one CIELO1(ENDF/B-VIII.0.β5) . This information gives a good indication of the current status of JEFF-3.3T4 covariances. A thorough review of the current covariance data files associated with the latest versions of the JENDL-4.0 updated files (JENDL-4.0u) and ENDF/B-VII.1 evaluated data files can be seen in reference .
Checking and processing issues are remarked in Section 4. After some checking tests of ENDF6 format (e.g. consistency between MF2 and MF32, energy ranges, etc.) and mathematical verification (e.g. positive definite matrix, abnormal values, etc.) few problems in raw covariances were noted. The complete set of JEFF-3.3T4 covariances (MF31, MF32/MF33, MF34 and MF35) are processed using the code NJOY2012.99 ; formatting and processing issues will be discussed in the paper.
The performance of JEFF-3.3T4 covariance library in criticality and safety analysis is outlined in Section 5. Nuclear data sensitivity tool (NDaST)  is able to propagate the covariance of nuclear data in 4501 ICSBEP benchmarks allowing to address this question in different fissile materials and neutron spectrum. This work is extended to the whole nuclear data library with especial emphasis on the four major actinides, 233U, 235U, 238U, and 239Pu. Finally, a summary of the criticality uncertainty results is given in Tables 1–4, showing the impact and differences of current covariance nuclear data evaluations.
The processing and verification of nuclear data covariances have been performed with the NEA tools and databases. These tools and databases are extensively used by the nuclear data community being an essential part of the Nuclear Data Services delivered by the NEA. Hereafter, a brief summary of these tools is presented emphasising the main features on nuclear data covariances:
The java-based nuclear information software (JANIS)  software developed by the NEA Data Bank is used to facilitate the visualisation and manipulation of nuclear data, giving access to evaluated nuclear data libraries, such as ENDF, JEFF, JENDL, TENDL, etc. JANIS is able to read different covariance formats: ENDF, COVERX, ERRORR and BOXER.
The nuclear data evaluation cycle (NDEC)  is used to process the JEFF-3.3T4 and ENDF/B-VIII.0β5 files. At the end of the processing NDEC produces two files, one HENDF and one BOXER. These files are then uploaded into JANIS database using the “Import Wizard” tool to create a new database. JANIS can also import directly covariance evaluations, such as SCALE-6.2 in COVERX format. For a comparison with other evaluations (e.g. ENDF/B-VII.1 and JENDL-4.0u) the NEA database is used. This NEA database provides covariances in ENDF and BOXER format for many libraries, although some important covariances are missed, such as neutron multiplicity data (nubar) and prompt fission neutron spectrum (PFNS or Chi). In this work, we have processed nubar and PFNS for ENDF/B-VII.1 and JENDL-4.0u adding the processed covariances to NEA database.
The 2016 database for the international criticality safety benchmark evaluation project (DICE) contains 567 evaluations representing 4874 critical, near-critical, or subcritical configurations into a standardised format that allows criticality safety analysis. This database is easily used to validate calculation tools and perform benchmarking to assess the performance of evaluated nuclear data libraries. DICE provides access to sensitivity coefficients (percent changes of k-effective due to elementary change of basic nuclear data) for the major nuclides and nuclear processes in a 30-group and 238-group energy structure for 4501 experimental configurations.
The NDaST is a Java based software, designed to perform calculations on nuclear data sensitivity files for benchmark cases. Here, NDaST is used for the calculation of the keff uncertainty due to evaluated nuclear covariance data. This allows simple and fast analysis for nuclear data evaluators to test the impact of nuclear data covariances across the 4501 ICSBEP benchmarks with sensitivities in DICE. This tool is able to predict the impact of different evaluated covariances of individual nuclides and cross-sections (e.g., elastic, inelastic, fission, capture, their cross-correlations, etc.), nubar and PFNS.
In order to more easily facilitate the input of covariances to NDaST, an automated link has been introduced to the JANIS nuclear data viewing software. From a search dialogue within the “Covariances” panel of NDaST, the user may search their public/private JANIS covariance databases for a given nuclide and reaction combination. Selection of covariance format BOXER, ENDF or COVERX returned from this search allows users to quickly calculate the propagated nuclear data uncertainty.
In a recent publication  referred as “Comments on covariance data of JENDL-4.0 and ENDF/B-VII.1”, the latest versions of the JENDL/4.0u and ENDF/B-VII.1 covariance data have been analysed. This report concluded that those evaluation of the covariance data had not yet matured or converged on the satisfactory level in their applications. In this section, we provide a comparison of nuclear data uncertainties (relative standard deviation (RSD) in %) for CIELO files (CIELO-1=ENDF/B-VIII and CIELO-2=JEFF-3.3) and the latest JENDL-4.0 and ENDF/B-VII.1 evaluations. In addition, SCALE-6.2rev8 covariance has been also included in this analysis.
ENDF/B-VIII.0β5(CIELO-1). The Beta-5 version of ENDF/B-VIII.0 files includes complete covariance matrices of the cross-sections, nubar, mubar and PFNS (at different energies, thermal, fast and high). The CIELO project is coordinated by the Nuclear Energy Agency/Working Party on Evaluation Cooperation (NEA/WPEC) Subgroup 40 since 2013. CIELO-1 cross-section data have been adopted by the ENDF project (https://www-nds.iaea.org/CIELO/).
JEFF-3.3T4 (CIELO-2). It is the latest test JEF-3.3 neutron library produced via an international collaboration of Data Bank participating countries under the auspices of the NEA Data Bank. The efforts of JEFF in 235U, 238U and 239Pu are also part of the collaboration in CIELO project. These files are the CIELO-2 set of cross-section data .
SCALE-6.2. The latest SCALE-6.2.rev8 library released in 2017 which contains covariance data for 402 materials is based on ENDF/B-VII.1 and SCALE-6.1. This library includes some important changes of ENDF/B-VII.1 data such as nubar 239Pu and 235U. The covariance library is given in 56 and 252 group energy structure in COVERX binary format. COGNAC utility code is used to convert COVERX files between binary and ASCII (https://www.ornl.gov/scale).
ENDF/B-VII.1 released in 2011 is largely aimed at incorporating covariance associated with a large number of nuclei and reactions, 190 materials (184 basically complete). The library is performed either using low-fidelity techniques or more robust methods relying on both experimental and model calculations; the three major actinides are evaluated with high fidelity (http://www.nndc.bnl.gov/endf/b7.1/).
JENDL-4.0 released in 2005 provides the data for 79 actinides. After 2005, JENDL-4.0 updated files (JENDL-4.0u) are available for nuclides whose nuclear data are partly revised from important and/or trivial error(s) (http://wwwndc.jaea.go.jp/jendl/j40/update/).
Each of the following figures shows the RSD in % of a certain reaction cross-section. JEFF-3.3T4 and ENDF/B-VIII.0β5 have been processed with the code NJOY2012.99 in BOXER format in 238 energy groups. ENDF/B-VII.1 and JENDL-4.0u covariances are taken directly from NEA database in BOXER section which nubar and PFNS data are processed with NJOY2012.99 for this work. The SCALE-6.2 covariance file in 56 energy groups has been imported into a new JANIS database.
Relative standard deviation (%) for 235U.
Relative standard deviation (%) for 239Pu.
Relative standard deviation (%) for 238U.
The latest beta release JEFF-3.3 neutron library, JEFF-3.3T4, contains 562 files, of which 447 files including covariances. The complete set of covariances is described as follows, MF31: 50 files, MF32/MF33: 446 files, MF34: 359 files, MF35: 35 files and MF40: 286 files. For the three major actinides, 235U, 238U and 239Pu, their covariances are evaluated using microscopic data and nuclear models. There are three nuclear data exceptions with reduced uncertainties based on the adjustment to criticality benchmarks in the fast energy region, 235U(nubar) and 239Pu(n,fission) and (nubar). For the 233U, neither PFNS covariances nor total nubar (only prompt and delayed) are given in the library.
Firstly, the pre-checking of ENDF6 format has shown some inconsistencies between MF2 and MF32 in 40 files. The processing is performed with NJOY2012.99. Only 2 files with problems were found: 39Ar which one of the l-state in MF32 mismatch the value given in MF2; and 9Be a cause of the problem in NJOY2012.99 to process MT values in the 875–890 range. Both problems were solved during this work .
NJOY2012.99 is used to generate four different BOXER files for MF31, MF32/33, MF34 and MF35. These files can be merged into a unique BOXER file to be added into the JANIS database. The 238 energy-group is selected as the energy structure to generate covariances, because this energy structure is the most common energy structure of the keff sensitivity profiles in DICE. As an example of the use of NJOY2012.99 to process covariance of PFNS, Figure 4 shows the input to produce covariance boxer files for 239Pu/JEFF-3.3T4. Figure 5 is an example of different RSD in % of PFNS for 239Pu/JEFF-3.3T4 as a function of different mean incident neutron fission energy.
A special NJOY input is needed to process cross-section covariance in JEFF-3.3T4 files with only MF32 section (e.g. 35Cl, 37Cl, 231Pa, 233Pa and 241Am). See Figure 6 for 231Pa's NJOY input.
LAMDA code  is applied to the full BOXER files generated to identify non-positive definite matrices, only 30 matrices with negative eigenvalues were found, of a total number of 6931. Large uncertainties values are also checked to identify potential problems either in the evaluation or in the processing step. None of these problems were found in matrices relevant for criticality uncertainty assessment.
An example of NJOY input to process MF35/PFNS covariance.
NJOY input to process files with only MF32.
RSD in % of 239Pu/JEFF-3.3T4 PFNS distributions as a function of mean incident neutron fission energy
The goal of this section is to assess the completeness of covariance files and the performance of these nuclear data uncertainties in a safety and criticality assessment. NDaST tool is bringing together the existing capabilities of both DICE and JANIS, to quickly propagate the impact of nuclear data covariances to criticality benchmarks. Generally speaking, the comparison of propagated nuclear data uncertainties against evaluated experimental uncertainties will give a good idea of the performance of the nuclear data. In addition, the comparison of propagated nuclear data uncertainties among nuclear data evaluations will permit to assess the completeness, disagreements and potential deficiencies of nuclear data covariances.
In order to more easily facilitate the analysis, NDaST shows graphically in a plot the keff C/E values (in red), experimental uncertainties (in blue) and the propagated nuclear data uncertainties (in green). Figure 7 shows these values for the selection of FAST/Pu benchmarks in the Mosteller suite  using the JEFF-3.3T4 library. In this Figure 7, the nuclear data uncertainties only take into account the 239Pu nuclear data uncertainty.
NDaST predicts the propagated uncertainty for a given nuclide and reaction combination. For the FAST/Pu benchmarks of Figure 7, in JEFF-3.3T4 the most important contributors to the keff uncertainty are fission (∼300 pcm), nubar (∼400 pcm) and PFNS (∼360 pcm). The contribution for elastic and inelastic cross-section uncertainties are smaller, ∼ 60 and ∼100 pcm, respectively. However, other nuclear data evaluations returned highest averaged values of uncertainty due to elastic and inelastic cross-sections, ENDF/B-VIII.0β5 (∼300 and ∼540 pcm), ENDF/B-VII.1 (∼290 and ∼540 pcm) and JENDL-4.0u1 (∼125 and ∼170 pcm).
Besides 239Pu in FAST/Pu cases, other nuclides contribute to increase the keff uncertainty. As an example, the JEFF-3.3T4 top contributors in PMF9-1 benchmark are 27Al(703 pcm), 239Pu(532 pcm) and 240Pu(182 pcm). For PMF8-1 benchmark are 239Pu(609 pcm), 232Th(296 pcm) and 240Pu(180 pcm). For the Mosteller suite, we have identified the most important contributor by isotope/element and by benchmark case for the JEFF-3.3T4 nuclear data evaluation. The following is a list of these results by element: 16O in HSI1-1: 367 pcm, 27Al in PMF9-1: 703 pcm, Fe in PMF26-1: 439 pcm, Cu in HMI6-4: 506 pcm, W in PMF5-1: 605 pcm, Zr in UCT1-3: 234 pcm, 233U in UMF1-1: 884 pcm, 235U in HMI6-4-1: 1564 pcm, 238U in IMF7-1: 970 pcm, 239Pu in PCI1-1: 2097 pcm, 240Pu in PMF2-1: 834 pcm, 241Pu in PST18-9: 472 pcm, 1H in UST8-1: 1302 pcm and 2H in HSI1-1: 2958 pcm.
Tables 1–4 give the averaged uncertainty (in pcm) in keff calculated with NDaST in the ICSBEP benchmark suite for each type of fissile material and neutron spectrum. Nuclear data covariances for the four major isotopes (233U, 235U, 238U and 239Pu) are propagated with DICE sensitivities and then averaged for the number of bechmarks of each type of fissile material. PFNS covariances are assumed at 1 MeV incident neutron fission energy.
The averaged experimental keff value is shown after the number of Benchmarks for comparison.
SCALE-6.2 shows lower uncertainties in Pu cases because the low value of nubar around 0.2% (similar to ENDF/B-VII.1). High uncertainties are found in HEU and IEU cases because the high 235U(n,γ) uncertainty in kev-MeV energy range. Also to be remarked the high contribution to keff uncertainty of 235U(PFNS) and 233U(PFNS).
In JEFF-3.3T4, the lack of uncertainty in 233U/PFNS gives the lower values for 233U cases (=ENDF/B-VII.1). The high uncertainty for 235U(n,fission) in keV-MeV provokes the largest uncertainties in HEU-IEU for FAST–INTERM neutron spectrum, ∼1100–1400 pcm. For PU case, the intermediate spectrum shows the highest uncertainty ∼1500 pcm, as a consequence of the high uncertainty in 239Pu (n,fission) and nubar.
JENDL-4.0u shows the higher uncertainties in 233U cases because the higher uncertainties in 233U nubar and PFNS. For PU-thermal and mixed neutron spectrum cases, it can be seen the impact of large uncertainty in JENDL-4.0u 239Pu(PFNS).
For ENDF/B-VIII.0β5, it is very significant the large uncertainty in 235U nubar, around 1% in the keV energy range which produces ∼1100 pcm keff uncertainty in the HEU and IEU/intermediate neutron spectrum cases. A comparison with ENDF/B-VII.1 in Table 1 shows lower uncertainty contribution for 235U PFNS and cross-sections. In addition, the uncertainty 238U(n,γ) is significantly smaller in CIELO-1 giving lower uncertainty in LEU and IEU cases. 239Pu fission and nubar uncertainties are increased in ENDF/B-VIII.0β5, it has a large impact in PU/INTER benchmarks. The 233U uncertainties for nubar and PFNS are taken from JENDL-4.0u.
Tables 1–4 show large values of the nuclear data uncertainty in comparison with the experimental uncertainty. In general, much more accurate criticality calculations are predicted with the evaluated librarires to match low |C-E| values. For instance, JEFF-3.3T4, for a set of 2233 ICSBEP benchmarks, it gives around 50% of benchmarks within 1σ experimental uncertainty and 90% of benchmarks within 1σ nuclear data uncertainty. It shows the too-wide range of nuclear data covariances.
NDaST output plot, keff C/E (in red), experimental (in blue) and propagated nuclear data uncertainties (in green) due to 239Pu covariance of JEFF-3.3T4.
Impact of different 235U nuclear data covariances in ICSBEP suite averaged for fissile material and spectrum.
Impact of different 238U nuclear data covariances in ICSBEP suite averaged for fissile material and spectrum.
Impact of different 239Pu nuclear data covariances in ICSBEP suite averaged for fissile material and spectrum.
Impact of different 233U nuclear data covariances in ICSBEP suite averaged for fissile material and spectrum.
JEFF-3.3T4 contains 447 files with covariance of average number of neutrons per fission (MF31), resonance parameters (MF32), cross-sections (MF33), angular distributions of elastic scattering (MF34), prompt fission spectrum (MF35) and radionuclide production (MF40). These covariances have been checked (e.g. ENDF6 format) and processed with NJOY2012.99. The verification of these covariances have been performed with mathematical (e.g. identifying negative eigenvalues) and physical (e.g. comparison with other evaluations) procedures, as well as quantifying the impact of these covariances in criticality uncertainty analysis.
Future developments in DICE/NDaST will permit to use covariance data for angular distributions. Other important feature is to extend the analysis to shielding benchmarks which will permit to quantify the impact of these covariances in other applications.
Recently, two new projects coordinated by the NEA-WPEC have been initiated: (i) Subgroup 46 on “Efficient and Effective Use of Integral Experiments for Nuclear Data Validation”  to define the methodology for verifying the physical properties of nuclear data covariances based on Adjustment methodologies; (ii) Subgroup 44 on “Investigation of Covariance Data in General Purpose Nuclear Data Libraries”  to provide guidance to the international community on methods for systematic and consistent evaluation of covariance data for the whole energy range. This underlines that defining credible nuclear data uncertainties remains still a challenging problem for the nuclear data community .
O. Cabellos and J. Dyrda conceived the present work. O. Cabellos carried out the first part of the work on checking and processing nuclear data covariance. O. Cabellos and J. Dyrda performed the verification of nuclear data uncertainties assessing the impact on keff uncertainty in the ICSBEP benchmark suite. O. Cabellos and J. Dyrda supervised the main findings of this work. N. Soppera updated JANIS and NDaST tools, new capabilities for visualization and computing were applied in this work. O. Cabellos wrote the manuscript with support from J. Dyrda and N. Soppera.
- JEFF-3.3T4, http://www.oecd-nea.org/dbdata/jeff-beta/JEFF33T4/ [Google Scholar]
- O. Cabellos et al., EPJ Web Conf. 146, 06004 (2017) [CrossRef] [Google Scholar]
- J. Dyrda, O. Cabellos, JEFF/DOC-1840 (2017) [Google Scholar]
- O. Cabellos, JEFF/DOC-1773 (2016) [Google Scholar]
- M.B. Chadwick et al., Nucl. Data Sheets 112, 2887 (2011) [CrossRef] [Google Scholar]
- K. Shibata et al., J. Nucl. Sci. Technol. 48, 1 (2011) [Google Scholar]
- B.T. Rearden, WPEC/SG44 meeting (2017) [Google Scholar]
- M.B. Chadwick et al., EPJ Web Conf. 146, 02001 (2017) [CrossRef] [Google Scholar]
- WPEC/SG39 Intermediate Report, NEA/NSC/R (2016) [Google Scholar]
- A.C. Kahler, NJOY2012.82, LA-UR-12-27079 (2017) [Google Scholar]
- J. Dyrda et al., EPJ Web Conf. 146, 06026 (2017) [CrossRef] [Google Scholar]
- N. Soppera et al., EPJ Web Conf. 146, 07006 (2017) [CrossRef] [Google Scholar]
- C.J. Diez et al., EPJ Web Conf. 146, 02026 (2017) [CrossRef] [Google Scholar]
- NJOY2012.99, https://www.oecd-nea.org/dbprog/njoy-links.html [Google Scholar]
- I. Kodeli, NEA-1798 ANGELO-LAMBDA [Google Scholar]
- G. Palmiotti, WPEC/SG46 meeting (2017) [Google Scholar]
- V. Sobes, WPEC/SG44 meeting (2017) [Google Scholar]
- M. Chadwick, CIELO Collaboration, Nucl. Data Sheets, to be published (2018) [Google Scholar]
Cite this article as: Oscar Cabellos, James Dyrda, Nicolas Soppera, Checking, processing and verification of nuclear data covariances, EPJ Nuclear Sci. Technol. 4, 39 (2018)
RSD in % of 239Pu/JEFF-3.3T4 PFNS distributions as a function of mean incident neutron fission energy
|In the text|
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.