Show last authors
1 = Exporting lab results to TerraIndex for a customer =
2
3 The file that is used for the examples: [[Example file>>attach:LabResults.xml]]
4
5 {{toc/}}
6
7 {{warning}}
8 SIKB Version 9 is obsolete, and replaced with version 13 or version 14. Latest version can be found here: [[https:~~/~~/www.sikb.nl/datastandaarden/sikb0101-bodembeheer>>url:https://www.sikb.nl/datastandaarden/sikb0101-bodembeheer]]
9 {{/warning}}
10
11 == What is a Lab result file ==
12
13 A lab result file is an XML file contains all the lab results. The results are mapped tot their analyses samples. A lab result will be matched to the corresponding analyses sample based on the: “Labassignment Guid/SIKB-Id, projectCode, AnalysisSample Guid/SIKB-Id”
14
15 **Example files**:
16
17 [[attach:labresultaat_IndividueelGr.xml||rel=" noopener noreferrer" target="_blank"]] [[attach:labresultaat_MengmonsterGr.xml||rel=" noopener noreferrer" target="_blank"]]
18
19 [[attach:labresultaat_IndividueelGw.xml||rel=" noopener noreferrer" target="_blank"]]
20
21
22 \\[[image:IMSIKB0101 - Labresults.png]]
23
24 == File structure ==
25
26
27 (% class="table-hover" %)
28 |(% colspan="1" rowspan="1" %)**Attribute name**|(% colspan="1" rowspan="1" %)**Description**|(% colspan="1" rowspan="1" %)**Unit**
29 |(% colspan="1" rowspan="1" %)**Versie**|(% colspan="1" rowspan="1" %)The SIKB version of the lab assignment. This must be: **9.0.0**|(% colspan="1" rowspan="1" %)string
30 |(% colspan="1" rowspan="1" %)**Applicatiecode**|(% colspan="1" rowspan="1" %)This is the application code of your LIMS system that you will get from TerraIndex. Be careful this is not the same code as your laboratory number|(% colspan="1" rowspan="1" %)Integer
31 |(% colspan="1" rowspan="1" %)**Datum**|(% colspan="1" rowspan="1" %)The date on which the lab result file was made|(% colspan="1" rowspan="1" %)(((
32 date
33
34 yyyy-mm-dd
35 )))
36 |(% colspan="1" rowspan="1" %)**Klantcode**|(% colspan="1" rowspan="1" %)This should be the customer code in the “//klantcode//” in the lab assignment|(% colspan="1" rowspan="1" %)string
37 |(% colspan="1" rowspan="1" %)**Laboratorium**|(% colspan="1" rowspan="1" %)The number you get from TerraIndex. This needs to be the same as the laboratorium number in the lab delivery file|(% colspan="1" rowspan="1" %)integer
38 |(% colspan="1" rowspan="1" %)**Taal**|(% colspan="1" rowspan="1" %)(((
39 The language of the lab results this depends on the XSD used.
40
41 dut = dutch
42
43 eng = English
44 )))|(% colspan="1" rowspan="1" %)string
45 |(% colspan="1" rowspan="1" %)**Projectgegevens**|(% colspan="1" rowspan="1" %)This section contains all the result information|(% colspan="1" rowspan="1" %)-
46
47 = Questions from Luca to Robin =
48
49 1. Do I need to add any other classes to the filestructure description apart from the ones below (those related to the IMMetingen::Result Class) ?
50 1. uit de mail van Robin : "Je kunt de Labassignment pagina als basis gebruiken, en de extra klasses vanuit de Voorbeeld bestand LabResult aan toevoegen."
51 11. De link naar een "LabResult" voorbeeld bestand wijst naar een directory. Daar staat wel een directory met naam "Example XML 14.8.01". maar die folder bevat niet 1 maar 4 verschillende "labresult_*" XMLs. Welke moet ik hebben? allemaal? en hoe moet ik afleiden welke klasses "extra" zijn? welke tool zou je aanbevelen om xml te lezen. ik heb er nog nooit mee gewerkt.
52 1. Do i need to add screenshots of the xml classes as in the labassignment and labdelivery pages? if so, what software did you use?
53 1. In Validation: ValidationScore. What are STOWA Protocols? is it Stichting Toegepast Onderzoek Waterbeheer?
54 1. What to do with the domain tables refered to in the descriptions? Does it make sense to reference them? Should i translate the names of the domain tables or is that static? are they translated already? who manages these? is it SIKB stuff?
55 1. in the section MeasureUncertainty > link to pdf file in description is invalid. What should it be?
56 1. SIKB 14 Parameter result combinations> first sentence makes no sense to me. Please review so i can translate.
57 1. What should i do with the sections from "Structure projectgegevens" to "What to exchange to store the right results?"? Is this a result of a copy paste and can they be discarded? If not, what classes do they refer to and where can i find the descriptions to be translated?
58
59 (% class="wikigeneratedid" %)
60 ~==== Added by luca: all Classes related to "IMMetingen::Results"
61
62 ==== MeasureResult ====
63
64
65 |**Attribute Name**|**Description**
66 |(((
67 **numericValue** Measure
68 )))|Numeric Value - the numerical value of the observation. When no unit for the measurement is known, the unit 'Dimensionless' should be used.
69 |(((
70 **valueProcessingMethod** GenericName
71 )))|(((
72 Value Processing Method - a mathematical/statistical operation that is applied while the method of value determination/analysis standard remains unchanged.
73
74 The operation can be applied to a series of measurement values with the same parameter (quantity/component or typing or taxon or object) or to a series of measurement values with the same analysis method that are summed up to a sum parameter.
75
76 Domain table: Value Processing Method
77 )))
78 |(((
79 **qualityIndicatorType** GenericName
80 )))|(((
81 Quality Indicator/Judgement -> Detection limit, etc.
82
83 Domain table: Quality Judgement
84 )))
85
86 ==== Accuracy ====
87
88
89 |**Attribute Name**|**Description**|**Unit**
90 |(((
91 **recovery** Float
92 )))|(((
93 The part (percentage) of material that is recovered in an analysis.
94 )))|Percentage [%]
95 |(((
96 **spread** Float
97 )))|Spread = the error measured (in %) in multiple repeated measurements of the same sample/situation (and by the same laboratory technician/measuring device).|Percentage [%]
98 |(((
99 **measurementUncertainty** Float
100 )))|Measurement uncertainty = the total error in the analysis (in %), considering sample collection, variation in measuring equipment/lab technician, and repeated measurements. It practically represents the value indicating the uncertainty of the measurement result.|Percentage [%]
101 |(((
102 **zScore** Float
103 )))|This is an optional value that indicates how the measurement value scores in relation to other techniques or laboratories. This could be from interlaboratory comparisons or comparisons between different measuring equipment.|
104 |(((
105 **drift** Float
106 )))|This is the degree of sensor drift over time (in %/year). Sensors will age over time and experience more or less drift depending on the conditions. This drift can be quantified and depends partly on age. This is especially true for online sensors.|Percentage [%]
107
108 ==== ====
109
110 ==== Validation ====
111
112
113 This DataClass contains optional attributes and indicates which validation steps the measureResult (measurement value) has undergone.
114
115
116 |**Attribute Name**|**Description**
117 |(((
118 **automatedControl** GenericName
119 )))|(((
120 The first-line control is often an automated check of whether the measurement value is correct. It uses a domain table: ValidationSteps.
121
122 Various steps can be distinguished. For example, a check on hard/soft limits, ion balance, bandwidth, and dissolved not exceeding total analysis (chemistry) are part of the first-line control. The control can be approved or disapproved (see quality judgment). Different possible values are described in the domain table ValidationSteps. Example: pH of 78 and water temperature of 123 degrees Celsius are hard limits (not possible); pH=10.0 is a soft limit because the value is extremely high (but not impossible).
123
124 Domain table: ValidationSteps
125 )))
126 |(((
127 **expertControl** GenericName
128 )))|(((
129 The second-line control (ExpertControl) is often a specialist check of whether the measurement value is correct. It also uses a domain table: ValidationSteps. Here, different steps can be distinguished as well. This analysis usually does not follow immediately after arrival but is performed periodically. Controls on correlation between measurement stations, history, correlations between parameters, and specialist expertise belong to the second-line control. The control can be approved or disapproved (see quality judgment). Different possible values are described in the domain table ValidationSteps.
130
131 Domain table: ValidationSteps
132 )))
133 |(((
134 **validationScore** GenericName
135 )))|(((
136 Score of the validation steps followed, according to the __**STOWA protocols**__. The attribute uses the domain table ValidationScore. The score value ranges from 0 to 5
137
138 Domain table: ValidationScore
139 )))
140
141 ==== ====
142
143 ==== AnalyticResult ====
144
145
146 The analyzed result of an observation, typically originating from a laboratory.
147
148
149 |=**Attribute Name**|=**Description**
150 |(((
151 **limitSymbol** CharacterString
152 )))|(((
153 LimietSymbool, allowed values: '<' en '>'.
154
155 '<' stands for 'less than the lowest threshold'
156
157 '>' stands for 'greater than the highest threshold'
158
159 The boundary for the limit symbol can be specified in the DeterminationLimits (LimitSymbolReferenceCode) as a reference with the actual value of the limit. The value can be included in the exchange in two ways:
160
161 1) as a CData block: <![CDATA[<]]> or <![CDATA[>]]>
162
163 2) as HTML code: '&amp; lt;' or '&amp; gt;'
164 )))
165 |(((
166 **alphanumericValue** CharacterString
167 )))|Textual value associated with an analysis result
168
169 ==== ====
170
171 ==== MeasureUncertainty ====
172
173
174 Measurement uncertainty in the result. This is the expanded measuring uncertainty as described in the document: [[http:~~/~~/www.nordicinnovation.net/nordtestfiler/tec537.pdf>>http://www.nordicinnovation.net/nordtestfiler/tec537.pdf]]
175
176
177 |=**Attribute Name**|=**Description**
178 |(((
179 **distributionType** GenericName
180 )))|(((
181 The type of statistical distribution associated with the observation.
182
183 Domain table: ProbabilityDistribution
184 )))
185 |(((
186 **statisticalParameter** Measure
187 )))|(((
188 Parameters that determine the shape and size of the statistical distribution.
189
190 Domain table: StatisticalParameter
191 )))
192
193 ==== ====
194
195 ==== DeterminationLimits ====
196
197
198 |=**Attribute Name**|=**Description**
199 |(((
200 **detectionLimit** Measure
201 )))|(((
202 The smallest value of the measured content or the observed value of the parameter in a sample, which can still be determined with a certain reliability by the laboratory. Conventionally, this is the amount that corresponds to three times the standard deviation at that level (thus, relative standard deviation is 33%).
203
204
205 The standard deviation is established under (intra-lab) reproducibility. Also known in English as 'LOD' (Limit of Detection). See also: [[Wikipedia on Detection Limit>>url:https://en.wikipedia.org/wiki/Detection_limit]]
206 )))
207 |(((
208 **reportingLimit** Measure
209 )))|The smallest value of the measured content or the observed value of the parameter in a sample, agreed upon with the client by the executing laboratory, which is reported to the client. The reporting limit is at least the detection limit and is sometimes specified in an accreditation scheme like AS3000.
210 |(((
211 **limitSymbolReferenceCode **GenericName
212 )))|(((
213 The threshold value that the limitSymbol of AnalyticResult refers to.
214
215 Domain table: LimitSymbolReference
216 )))
217 |(((
218 **quantitationLimit** Measure
219 )))|The smallest value of the measured content or the observed value of the parameter in a sample, which can still be determined with a certain reliability by the laboratory. Conventionally, this is the amount that corresponds to ten times the standard deviation at that level (thus, relative standard deviation is 10%). Also known in English as 'LOQ' (Limit of Quantitation). At this value, the rate of 'false negatives' is less than 1%.
220
221 === ===
222
223 === Structure projectgegevens ===
224
225 (% style="text-align:center" %)
226 [[image:1637656734277-997.png]]
227
228
229 (% class="table-hover" %)
230 |(% colspan="1" rowspan="1" %)**Attribute name**|(% colspan="1" rowspan="1" %)**Description**|(% colspan="1" rowspan="1" %)**Unit**
231 |(% colspan="1" rowspan="1" %)**idopdracht**|(% colspan="1" rowspan="1" %)The TerraIndex id of the lab assignment the result belongs to.|(% colspan="1" rowspan="1" %)-
232 |(% colspan="1" rowspan="1" %)**projectcode**|(% colspan="1" rowspan="1" %)The project code of the project as it was delivered in the lab assignment|(% colspan="1" rowspan="1" %)string
233 |(% colspan="1" rowspan="1" %)**projectnaam**|(% colspan="1" rowspan="1" %)The name of the project as it was delivered in the lab assignment.|(% colspan="1" rowspan="1" %)string
234 |(% colspan="1" rowspan="1" %)**ordernummer**|(% colspan="1" rowspan="1" %)Not relevant. The order in which the lab result could be shown|(% colspan="1" rowspan="1" %)string
235 |(% colspan="1" rowspan="1" %)**projectleider**|(% colspan="1" rowspan="1" %)The project leader of the customer. This needs the be the “contactpersoon” from the lab assignment with the code PL|(% colspan="1" rowspan="1" %)string
236 |(% colspan="1" rowspan="1" %)**status**|(% colspan="1" rowspan="1" %)The status of the lab assignment. See Labstatus Codegroup 76 in the attachments for all the options.|(% colspan="1" rowspan="1" %)integer
237 |(% colspan="1" rowspan="1" %)**datumverwacht**|(% colspan="1" rowspan="1" %)The date on which the lab expects the certificate to be available|(% colspan="1" rowspan="1" %)Date
238 yyyy-mm-dd
239 |(% colspan="1" rowspan="1" %)**certificaatnummer**|(% colspan="1" rowspan="1" %)The number of the certificate that will be send to the user.|(% colspan="1" rowspan="1" %)string
240 |(% colspan="1" rowspan="1" %)(((
241 **analysemonsters**
242
243
244
245 )))|(% colspan="1" rowspan="1" %)A table containing all the analysis sample with their corresponding results|(% colspan="1" rowspan="1" %)-
246
247 == Structure analysemonsters ==
248
249 (% style="text-align:center" %)
250 [[image:1637656914799-534.png]]
251
252 (% class="table-hover" %)
253 |(% colspan="1" rowspan="1" %)**Attribute name**|(% colspan="1" rowspan="1" %)**Description**|(% colspan="1" rowspan="1" %)**Unit**
254 |(% colspan="1" rowspan="1" %)**Idanlmons**|(% colspan="1" rowspan="1" %)The unique identification code of the analyses sample as given in the lab assignment file|(% colspan="1" rowspan="1" %)string
255 |(% colspan="1" rowspan="1" %)**Anlmons**|(% colspan="1" rowspan="1" %)The name of the analyses sample as given in the lab assignment file|(% colspan="1" rowspan="1" %)string
256 |(% colspan="1" rowspan="1" %)**Certificaat**|(% colspan="1" rowspan="1" %)The way the name of the sample should be on the certificate. This is also given in the lab assignment|(% colspan="1" rowspan="1" %)string
257 |(% colspan="1" rowspan="1" %)**Monstersoort**|(% colspan="1" rowspan="1" %)The code referencing the type the sample is. Check the attachment: Sample type codegroup 51 for all the options|(% colspan="1" rowspan="1" %)integer
258 |(% colspan="1" rowspan="1" %)**Status**|(% colspan="1" rowspan="1" %)The status of the sample. See Labstatus Codegroup 76 in the attachments.|(% colspan="1" rowspan="1" %)integer
259 |(% colspan="1" rowspan="1" %)**Datumverwacht**|(% colspan="1" rowspan="1" %)The date on which the results for the sample are expected|(% colspan="1" rowspan="1" %)(((
260 date
261
262 yyyy-mm-dd
263 )))
264 |(% colspan="1" rowspan="1" %)**Volgorde**|(% colspan="1" rowspan="1" %)Is a unused field in TerraIndex|(% colspan="1" rowspan="1" %)integer
265 |(% colspan="1" rowspan="1" %)**analyseresultaten**|(% colspan="1" rowspan="1" %)A table containing all the measurement values of the analysis samples.|(% colspan="1" rowspan="1" %)-
266
267 == Structure analyseresultaten ==
268
269 (% style="text-align:center" %)
270 [[image:1637657248973-790.png]]
271
272 (% class="table-hover" %)
273 |(% colspan="1" rowspan="1" %)**Attribute name**|(% colspan="1" rowspan="1" %)**Description**|(% colspan="1" rowspan="1" %)**Unit**
274 |(% colspan="1" rowspan="1" %)**componentcode**|(% colspan="1" rowspan="1" %)The SIKB component code. See ComponentCode Codegroup 52 in the attachements for all possible options.|(% colspan="1" rowspan="1" %)integer
275 |(% colspan="1" rowspan="1" %)**meetwaarde**|(% colspan="1" rowspan="1" %)What the measured value is for the analyses|(% colspan="1" rowspan="1" %)float
276 |(% colspan="1" rowspan="1" %)**meetwaardeomschrijving**|(% colspan="1" rowspan="1" %)Alpha numerical description of the result|(% colspan="1" rowspan="1" %)string
277 |(% colspan="1" rowspan="1" %)**eenheidcode**|(% colspan="1" rowspan="1" %)The unit of the measured value. See Unit CodeGroup 40 in the attachements for all possible options|(% colspan="1" rowspan="1" %)integer
278 |(% colspan="1" rowspan="1" %)**referentiecode**|(% colspan="1" rowspan="1" %)This defines what the reference for the measurement value is. See ReferenceType CodeGroup 41 for all the possible options|(% colspan="1" rowspan="1" %)integer
279 |(% colspan="1" rowspan="1" %)**analysenorm**|(% colspan="1" rowspan="1" %)Against which standard the analysis has been tested. See Laboratory method Codegroup 57 in the attachments for all the option. I your standard is not in the list leave this empty|(% colspan="1" rowspan="1" %)integer
280 |(% colspan="1" rowspan="1" %)**datummonstervoorbehandeling**|(% colspan="1" rowspan="1" %)The date on which the sample was pre-treated. We don’t do anything with this value|(% colspan="1" rowspan="1" %)(((
281 date
282
283 yyyy-mm-dd
284 )))
285 |(% colspan="1" rowspan="1" %)**opmerking**|(% colspan="1" rowspan="1" %)A remark for this result|(% colspan="1" rowspan="1" %)string
286 |(% colspan="1" rowspan="1" %)**certificering**|(% colspan="1" rowspan="1" %)Under which certificate the analyses has been done. See CertificateCode Codegroup 48 for all the possible options. If you do not find you code leave this field empty|(% colspan="1" rowspan="1" %)integer
287 |(% colspan="1" rowspan="1" %)**status**|(% colspan="1" rowspan="1" %)The status of the labresult in the labassignemnt. See Labstatus Codegroep 76 in the attachments|(% colspan="1" rowspan="1" %)integer
288 |(% colspan="1" rowspan="1" %)**datumverwacht**|(% colspan="1" rowspan="1" %)Date on which the analyses results are expected.|(% colspan="1" rowspan="1" %)date
289
290 = =
291
292 = What to exchange to store the right results? =
293
294 The data stream ‘Lab Result’ is the feedback of analysis results on the requested lab assignment at a laboratory.
295
296 **Important fields:**
297
298 |=Entity|=Fixed value|=Remark
299 |**Project**|lokaalID (GUID)|As submitted in the Lab assignment XML
300 | |projectCode|As submitted in the Lab assignment XML
301 |**Labassignment**|lokaalID (GUID)|As submitted in the Lab assignment XML
302 |**Sample (analysis sample)**|lokaalID (GUID)|As submitted in the Lab assignment XML, if assignment in SIKB<11, but results in >=11; fill with old BISNR/IDANLMONS.
303 | |Name|As submitted in the Lab assignment XML
304 |**Sample (field sample)**|(((
305 lokaalID (GUID)
306 )))|Only if this entity is included, which is optional.
307
308 **Remarks:**
309
310 * The entity ‘Analysis Result’ does not yet have a fixed lokaalID (GUID), connected laboratories cannot yet guarantee that a unique ID will be generated.
311 * For Asbestos and Asphalt, new samples are also created at the Lab, which are therefore fed back with a reference to the sample from which they are derived.
312 * There is still a desire to feedback from a lab whether an analysis sample has been modified at the lab in terms of sub-samples. For example, if a jar has broken and been replaced with another jar. This has not yet been included in current practices.
313
314 **Importing the data can be done based on the following steps:**
315
316 * Search Project with Project.lokaalID (as placed in the Lab assignment XML).
317 * Search Project with Project.ProjectCode (as placed in the Lab assignment XML) if searching on Project.LokaalID yields no results.
318 * Search Project and Lab assignment with Labassignment.LokaalID (as placed in the Lab assignment XML) if the Project has not yet been found.
319 * Search Project (if Project not yet found) and Analysis Sample with Sample.LokaalID as GUID (as placed in the Lab assignment XML, version 11 and higher).
320 * Search Project (if Project not yet found) and Analysis Sample with Sample.LokaalID as BISNR (as placed in the Lab assignment XML, versions lower than 11, 'old' idanlmons/BISNR).
321 * Search Analysis Sample with Sample.Name within the project, if the Analysis Sample has not been found but the project has.
322
323 **What can be imported?**
324
325 * If an Analysis Sample is found, the Analysis Results are always updated or added.
326 * If Project is found, but the analysis sample is not; then this analysis sample is imported as a new analysis sample with all results.
327 * (If it concerns water samples, a new fictional/temporary measuring point and filter could be created.)
328
329 = SIKB 14 Parameter result combinations =
330
331 In the SIKB0101 version 14 exchange of **__labresults is combination needed __**for exchanging the result parameters of the Lab analysis.
332 It's based on PhysicalProperty, the combination of Quantity, Parameter and Condition.
333 \\[[image:1713183008796-215.png]]
334 *small remark, condition will be used as: [0..1]
335
336 The combinations are defined for different compartiments like soil/ground, groundwater, wastewater.
337 Below are some examples, and some attachments included to support all combinations.
338
339 **2 Examples for Soil:**
340
341 |__**Parameter Name**__|__**Parameter ID**__|__**Quantity ID**__|__**Quantity name**__|__**Condition ID**__|__**Condition Name**__
342 |lood|1116|2725|Massafractie|1|t.o.v. drooggewicht
343 |minerale olie|1200|2725|Massafractie|93|koolwaterstoffractie C10-C40 / drooggewicht
344
345 **2 Examples for Groundwater:**
346
347 |__**Parameter Name**__|__**Parameter ID**__|__**Quantity ID**__|__**Quantity name**__|__**Condition ID**__|__**Condition Name**__|
348 |cyanide-complex|2595|2720|(massa)Concentratie|9|opgeloste fractie (bijv. na filtratie)
349 |som 29 dioxines (Bbk, 1-10-2010, als TEQ)|2160|2720|(massa)Concentratie|10|uitgedrukt in Toxiciteit equivalenten
350
351 **2 Examples for Wastewater:**
352
353 |__**Parameter Name**__|__**Parameter ID**__|__**Quantity ID**__|__**Quantity name**__|__**Condition ID**__|__**Condition Name**__|
354 |cyanide-complex|2595|2720|(massa)Concentratie|8|Niet van toepassing
355 |som 29 dioxines (Bbk, 1-10-2010, als TEQ)|2160|2720|(massa)Concentratie|10|uitgedrukt in Toxiciteit equivalenten
356
357 __**Full combinations sheet:  **__[[attach:Full List of AnalysisResult combinations 04-2024.xlsx||rel="noopener noreferrer" target="_blank"]]
358
359
360
361
TerraIndex
asd