Changes for page Download a project (export)

Last modified by Robert Jan Daams on 2025/03/05 18:02

From version < 1.3 >

edited by Roelof Zwaan
on 2021/11/22 10:43

To version < 6.7 >

edited by Robert Jan Daams
on 2022/08/24 15:16

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (3 modified, 0 added, 0 removed)

Details

Page properties

Parent

@@ -1,1 +1,1 @@
--Implementatie dcoumentatie.WebHome
++Implementation documentation.WebHome

Author

@@ -1,1 +1,1 @@
--XWiki.RoelofZwaan
++XWiki.RjDaams

Content

@@ -16,6 +16,26 @@
  (((
  (% class="col-xs-12 col-sm-8" %)
  (((
++== Changelog ==
++
++=== Update 2022-08-23 ===
++
++As part of on-going efforts to improve performance and scalability, we have introduced a dedicated version of DataWS named DataWSExternals.  This new service should be used for external API consumers.
++
++| |**URL**|
++|**Old**|{{code language="none"}}https://web.terraindex.com/DataWS/{{/code}}|(((
++[[https:~~/~~/web.terraindex.com/DataWS/ITWDataRestService_V1_0/GetProjectsJSON>>https://web.terraindex.com/DataWS/ITWDataRestService_V1_0/GetProjectsJSON]]
++
++[[https:~~/~~/web.terraindex.com/DataWS/ITWImportExportServiceASMX_V1_0.asmx>>https://web.terraindex.com/DataWSExternals/ITWImportExportServiceASMX_V1_0.asmx]]
++)))
++|**New**|{{code language="none"}}https://web.terraindex.com/DataWSExternals/{{/code}}|(((
++[[https:~~/~~/web.terraindex.com/DataWSExternals/ITWDataRestService_V1_0/GetProjectsJSON>>https://web.terraindex.com/DataWSExternals/ITWDataRestService_V1_0/GetProjectsJSON]]
++
++[[https:~~/~~/web.terraindex.com/DataWSExternals/ITWImportExportService_V1_0.svc>>https://web.terraindex.com/DataWSExternals/ITWImportExportService_V1_0.svc]]
++)))
++
++==  ==
++
  == 1. Retreive all changed project from TerraIndex ==
  To retreive all changed project from the TerraIndex database since a specific timestamp, there is a webservice call you can do. This will return all project rows that have changes since the timestamp you send within the request.
@@ -22,7 +22,7 @@
  This way you only download projects that have changes, and it will not request project that are not needed, so it won’t keep our servers busy with exports that are not necessary.
  To start connecting this webservice, you should use this URL:
--[[https:~~/~~/web.terraindex.com/DataWS/ITWDataRestService_V1_0/GetProjectsJSON>>url:https://web.terraindex.com/DataWS/ITWDataRestService_V1_0/GetProjectsJSON]]
++[[https:~~/~~/web.terraindex.com/DataWSExternals/ITWDataRestService_V1_0/GetProjectsJSON>>https://web.terraindex.com/DataWSExternals/ITWDataRestService_V1_0/GetProjectsJSON]]
  Fill the **Body **of a **POST **HTTP call with:
@@ -36,7 +36,7 @@
      "Language": "en"
    },
    "LanguageCode": "en",
--  "WebserviceVersion": 1,
++  "WebserviceVersion": "1.0",
    "SearchFilter": "",
    "ArchiveID": 0,
    "PageSize": 30,
@@ -238,10 +238,10 @@
  == 2. Retreive the project export from TerraIndex ==
  To request the export from TerraIndex we have a SOAP webservice. This webservice is called the ExportService, and it will provide a full project in TerraIndex Format.
--The format of the projectfile is documentated here: [[Documentation TerraIndex Export format - dsFieldProject.xsd>>Implementatie dcoumentatie.Documentation TerraIndex Export format - dsFieldProject\.xsd.WebHome]]
++The format of the projectfile is documentated here: [[Documentation TerraIndex Export format - dsFieldProject.xsd>>Implementation documentation.Documentation TerraIndex Export format - dsFieldProject\.xsd.WebHome]]
  To start connecting this webservice, you should use this URL of the Import Export Webservice:
--[[https:~~/~~/web.terraindex.com/DataWS/ITWImportExportServiceASMX_V1_0.asmx>>url:https://web.terraindex.com/DataWS/ITWImportExportServiceASMX_V1_0.asmx]]
++[[https:~~/~~/web.terraindex.com/DataWSExternals/ITWImportExportServiceASMX_V1_0.asmx>>https://web.terraindex.com/DataWSExternals/ITWImportExportServiceASMX_V1_0.asmx]]
  With this URL many IDE’s can create a proxy for you, just by providing the URL. Once this proxy is created, you will have a few classes looking like the call in the image below.
@@ -256,12 +256,15 @@
  Also fill the license and the applicationCode. //(These two fields can be requested at the TerraIndex Servicedesk.)//
 ; Fill the **ExportType **'**Export_FIELD_XML_v1_0_0**’. This export corresponds with dsFieldProject.xsd and is the best XML to connect TI with.
  Create at least create 2 parameters as in the image. Beacause 2 parameters are needed.
++//If JSON is prevered use: ExportType = 'Export_FIELD_JSON_v1_0_0'//
 ; Fill the parameter with the FileName.
 ; Fill the parameter with **projectID**. Instead of ‘ProjectID' it’s also possible to fill the parameter ‘ProjectCode'.
 ; Send the request and wait for the reponse. In response field ‘ResultCode’ should be 'SUCCES’ when it all went OK. If not it will tell what went wrong.
 ; The response field 'Filecontent’is filled if it went OK, and it contains XML you can serialize.
--\\*Username and password are known by each TI user and the application manager of your company can create new usernames.
++10; an extra parameter is added calles: **UseZipStream**. The result data is default Base64 encoded, if you add UseZipStream = true, the result string is GZIPSTREAMED Base64 encoded. **At the end of this page, we have added an class as code, to parse the base64 or ZIPStream Base64 to a normal string.**
++*Username and password are known by each TI user and the application manager of your company can create new usernames.
++
  **EXAMPLE CODE**
  ExportType:
@@ -303,11 +303,76 @@
  Example call
--<soapenv:Envelope xmlns:soapenv="http:~/~/schemas.xmlsoap.org/soap/envelope/" xmlns:itw="https:~/~/wsterraindex.terraindex.com/ITWorks.TerraIndex/"> <soapenv:Header/> <soapenv:Body> <itw:Export> <itw:request> <itw:AuthorisationRequest> <itw:Username>USERNAME</itw:Username> <itw:Password>PASSWORD</itw:Password> <itw:Licensenumber>LICENSE</itw:Licensenumber> <itw:ApplicationCode>APPCODE</itw:ApplicationCode> </itw:AuthorisationRequest> <itw:WebserviceVersion>1.0</itw:WebserviceVersion> <itw:LanguageCode>nld</itw:LanguageCode> <itw:UseCompression>true</itw:UseCompression> <itw:TypeOfExport>Export_FIELD_XML_v1_0_0</itw:TypeOfExport> <itw:Parameters> <itw:ExportParameter> <itw:ParameterType>FileName</itw:ParameterType> <itw:StringValue>Export</itw:StringValue> </itw:ExportParameter> <itw:ExportParameter> <itw:ParameterType>projectID</itw:ParameterType> <itw:FloatValue>917</itw:FloatValue> </itw:ExportParameter> ~-~-~-~-- <itw:ExportParameter> <itw:ParameterType>ProjectCode</itw:ParameterType> <itw:StringValue>202020</itw:StringValue> </itw:ExportParameter> ~-~-~-~- </itw:Parameters> <itw:LogFormat>XML</itw:LogFormat> <itw:UseZipStream>true</itw:UseZipStream> </itw:request> </itw:Export> </soapenv:Body></soapenv:Envelope>
++{{code language="none" layout="LINENUMBERS"}}
++<soapenv:Envelope
++ xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
++ xmlns:itw="https://wsterraindex.terraindex.com/ITWorks.TerraIndex/">
++ <soapenv:Header></soapenv:Header>
++ <soapenv:Body>
++  <itw:Export>
++   <itw:request>
++    <itw:AuthorisationRequest>
++     <itw:Username>USERNAME</itw:Username>
++     <itw:Password>PASSWORD</itw:Password>
++     <itw:Licensenumber>LICENSE</itw:Licensenumber>
++     <itw:ApplicationCode>APPCODE</itw:ApplicationCode>
++    </itw:AuthorisationRequest>
++    <itw:WebserviceVersion>1.0</itw:WebserviceVersion>
++    <itw:LanguageCode>nld</itw:LanguageCode>
++    <itw:UseCompression>true</itw:UseCompression>
++    <itw:TypeOfExport>Export_FIELD_XML_v1_0_0</itw:TypeOfExport>
++    <itw:Parameters>
++     <itw:ExportParameter>
++      <itw:ParameterType>FileName</itw:ParameterType>
++      <itw:StringValue>Export</itw:StringValue>
++     </itw:ExportParameter>
++     <itw:ExportParameter>
++      <itw:ParameterType>projectID</itw:ParameterType>
++      <itw:FloatValue>917</itw:FloatValue>
++     </itw:ExportParameter> -----
++     <itw:ExportParameter>
++      <itw:ParameterType>ProjectCode</itw:ParameterType>
++      <itw:StringValue>202020</itw:StringValue>
++     </itw:ExportParameter> ----
++    </itw:Parameters>
++    <itw:LogFormat>XML</itw:LogFormat>
++    <itw:UseZipStream>true</itw:UseZipStream>
++   </itw:request>
++  </itw:Export>
++ </soapenv:Body>
++</soapenv:Envelope>
++{{/code}}
  Example response:
--<soap:Envelope xmlns:soap="http:~/~/schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http:~/~/www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http:~/~/www.w3.org/2001/XMLSchema"> <soap:Body> <ExportResponse xmlns="https:~/~/wsterraindex.terraindex.com/ITWorks.TerraIndex/"> <ExportResult> <ResultCode>Export_Succes</ResultCode> <TypeOfExport>Export_TI_v1_0_0</TypeOfExport> <Files> <File> <FileName>917.xml</FileName> <TypeOfFile>Field_XML_Compressed</TypeOfFile> <FileContent>H4sIAAAAAAAEAFWRuZaqQABEP4hAGnAGggm6odlREFkkA2WRRRCBxv76YeYF70yFVXUqqBvgl4KQBzcZ8Aho2iqxdhxDSPDmNGjz9Z/weMa8/aimTAUeF42KgxRRzd3YaGfdXtvECEBvWafSNwf+dOsjVXpZUzs+lw/p3gBhuXQ5S8T3MdIBlxUQEam+LOVgVo4D8w4c2E8pEgp3haewcpQx1KQ41Z8DKWv16seaDLp3GABLuIKXK5Ucq31EfSXm0172YvG87hcbayYGdB1t0CbcuueLpU5UawgHSitFr564Aet5LeegD0/tocZDTvuIuc9Ja0tDFt/m7kZnomdVJc+2SkqBGXmTdPiiPzJa2OznLkX67p2PCNM7iHU11QbIilVkMDBVd0J8gK4Ams6ycJQagnww/SaxuiZ/EdS6DZ0cf17BIhUq87CSkQvxat/2dEG1xu94BoaeT7C8XR38/C1DZbpygwfW+gk8Z+Mgm3DDhAj8r6099Rj+5YNs5F3+5R5EUPmd6+EvYvj1Dd8o9lLwAQAA</FileContent> </File> <File> <FileName>ProjectInfo.xml</FileName> <TypeOfFile>Field_XML_Compressed</TypeOfFile> <FileContent>H4sIAAAAAAAEAI1Qy5JDQAD8IAdj1/M4hJggDBnEbTxDsV7BxtdvNqm9bx+6urq7+tBEnw+qiuETCLrcTlst9Pajtb0soj7JeynztNIubHK9XZJOXoojN8dXpaxltOlOwAZzK033Edx7HWT1ZFVYNljpsT7iCVDbxb5tlmw3GhV7vgty5jqiGzWSYEvL7RCIQifzchIoMJnHz+fO17C4JAwA0hNRb247SR1ba8OunCV4ralK1rjwBhUAJ2pihopeuxqXIUecePETLhx8zT6IZX5GzafC0XHTrauISeyIM2+2g1PzEymRZrTtglKlsFYHXDKmoYTp+jw1zNDyAFZOTN9XHkuNGmU33905uipWMTsjm2ccm6+bxqk2xAjCf/z3BwS1j+qVqTjrlDGJziCIhC59CHwafeNgI8d3U4cQQ+VXSdXb+QGLuAuvrAEAAA==</FileContent> </File> </Files> </ExportResult> </ExportResponse> </soap:Body></soap:Envelope>
++{{code language="none"}}
++<soap:Envelope
++ xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/"
++ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
++ xmlns:xsd="http://www.w3.org/2001/XMLSchema">
++ <soap:Body>
++  <ExportResponse
++   xmlns="https://wsterraindex.terraindex.com/ITWorks.TerraIndex/">
++   <ExportResult>
++    <ResultCode>Export_Succes</ResultCode>
++    <TypeOfExport>Export_TI_v1_0_0</TypeOfExport>
++    <Files>
++     <File>
++      <FileName>917.xml</FileName>
++      <TypeOfFile>Field_XML_Compressed</TypeOfFile>
++      <FileContent>H4sIAAAAAAAEAFWRuZaqQABEP4hAGnAGggm6odlREFkkA2WRRRCBxv76YeYF70yFVXUqqBvgl4KQBzcZ8Aho2iqxdhxDSPDmNGjz9Z/weMa8/aimTAUeF42KgxRRzd3YaGfdXtvECEBvWafSNwf+dOsjVXpZUzs+lw/p3gBhuXQ5S8T3MdIBlxUQEam+LOVgVo4D8w4c2E8pEgp3haewcpQx1KQ41Z8DKWv16seaDLp3GABLuIKXK5Ucq31EfSXm0172YvG87hcbayYGdB1t0CbcuueLpU5UawgHSitFr564Aet5LeegD0/tocZDTvuIuc9Ja0tDFt/m7kZnomdVJc+2SkqBGXmTdPiiPzJa2OznLkX67p2PCNM7iHU11QbIilVkMDBVd0J8gK4Ams6ycJQagnww/SaxuiZ/EdS6DZ0cf17BIhUq87CSkQvxat/2dEG1xu94BoaeT7C8XR38/C1DZbpygwfW+gk8Z+Mgm3DDhAj8r6099Rj+5YNs5F3+5R5EUPmd6+EvYvj1Dd8o9lLwAQAA</FileContent>
++     </File>
++     <File>
++      <FileName>ProjectInfo.xml</FileName>
++      <TypeOfFile>Field_XML_Compressed</TypeOfFile>
++      <FileContent>H4sIAAAAAAAEAI1Qy5JDQAD8IAdj1/M4hJggDBnEbTxDsV7BxtdvNqm9bx+6urq7+tBEnw+qiuETCLrcTlst9Pajtb0soj7JeynztNIubHK9XZJOXoojN8dXpaxltOlOwAZzK033Edx7HWT1ZFVYNljpsT7iCVDbxb5tlmw3GhV7vgty5jqiGzWSYEvL7RCIQifzchIoMJnHz+fO17C4JAwA0hNRb247SR1ba8OunCV4ralK1rjwBhUAJ2pihopeuxqXIUecePETLhx8zT6IZX5GzafC0XHTrauISeyIM2+2g1PzEymRZrTtglKlsFYHXDKmoYTp+jw1zNDyAFZOTN9XHkuNGmU33905uipWMTsjm2ccm6+bxqk2xAjCf/z3BwS1j+qVqTjrlDGJziCIhC59CHwafeNgI8d3U4cQQ+VXSdXb+QGLuAuvrAEAAA==</FileContent>
++     </File>
++    </Files>
++   </ExportResult>
++  </ExportResponse>
++ </soap:Body>
++</soap:Envelope>
++{{/code}}
  == Zip Stream class ==
@@ -314,7 +314,132 @@
  If needed, this is the Zip Stream class you can use to extract the zipstream as used above:
--~/~// <summary> ~/~// Helper class for compress en decompress of file data ~/~// </summary> public static class ZipStreamHelper { #region Compress and encode ~/~// <summary> ~/~// Comprimeer een string en geeft deze terug in Base64 string. ~/~// </summary> ~/~// <param name="content">filecontent</param> ~/~// <returns>gecomprimeerde string</returns> public static string CompressToBase64String(string content) { ~/~/string to byte[] byte[] contentArray = stringToByteArray(content); ~/~/ Compress byte[] compressed = Compress(contentArray); return base64_encode(compressed); } ~/~// <summary> ~/~// Zet een string om naar een ByteArray ~/~// </summary> ~/~// <param name="content">filecontent</param> ~/~// <returns>ByteArray</returns> public static byte[] stringToByteArray(string content) { System.Text.UTF8Encoding encoding = new System.Text.UTF8Encoding(); return encoding.GetBytes(content); } ~/~// <summary> ~/~// comprimeer een ByteArray ~/~// </summary> ~/~// <param name="data">filedata als ByteArray</param> ~/~// <returns>gecomprimeerde ByteArray</returns> public static byte[] Compress(byte[] data) { using (var compressedStream = new MemoryStream()) using (var zipStream = new GZipStream(compressedStream, CompressionMode.Compress)) { zipStream.Write(data, 0, data.Length); zipStream.Close(); return compressedStream.ToArray(); } } ~/~// <summary> ~/~// Zet een ByteArray om naar een Base64 string ~/~// </summary> ~/~// <param name="data">gecomprimeerde ByteArray</param> ~/~// <returns>Base 64 string</returns> public static string base64_encode(byte[] data) { if (data == null) return string.Empty; return Convert.ToBase64String(data); } ~/~// <summary> ~/~// Zet een string om naar een Base64 string ~/~// </summary> ~/~// <param name="data">string</param> ~/~// <returns>Base 64 string</returns> public static string string_base64_encode(string data) { if (string.IsNullOrEmpty(data)) return string.Empty; ~/~/string to byte[] byte[] contentArray = stringToByteArray(data); return base64_encode(contentArray); } #endregion #region Decompress and decode ~/~/ Decode and decompress ~/~// <summary> ~/~// Decomprimeer een Base64 string naar een string ~/~// </summary> ~/~// <param name="contentBase64">GZIP Base64 string</param> ~/~// <returns>string</returns> public static string DecompressBase64StringToString(string contentBase64) { ~/~/ Decompress byte[] decoded = base64_decode(contentBase64); byte[] decompressed = Decompress(decoded); return byteArrayTostring(decompressed); } ~/~// <summary> ~/~// Zet een ByteArray om in een normale string ~/~// </summary> ~/~// <param name="data">ByteArray</param> ~/~// <returns>string</returns> public static string byteArrayTostring(byte[] data) { System.Text.UTF8Encoding enc = new System.Text.UTF8Encoding(); return enc.GetString(data); } ~/~// <summary> ~/~// Zet een Base64 string om naar een ByteArray ~/~// </summary> ~/~// <param name="encodedData">Base64 string</param> ~/~// <returns>gecomprimeerde ByteArray</returns> public static byte[] base64_decode(string encodedData) { byte[] encodedDataAsBytes = Convert.FromBase64String(encodedData); return encodedDataAsBytes; } ~/~// <summary> ~/~// Zet een gecomprimeerde ByteArray om in een ByteArray ~/~// </summary> ~/~// <param name="data">gecomprimeerde ByteArray</param> ~/~// <returns>ByteArray (gedecomprimeerd)</returns> public static byte[] Decompress(byte[] data) { using (var compressedStream = new MemoryStream(data)) using (var zipStream = new GZipStream(compressedStream, CompressionMode.Decompress)) using (var resultStream = new MemoryStream()) { var buffer = new byte[4096]; int read; while ((read = zipStream.Read(buffer, 0, buffer.Length)) > 0) { resultStream.Write(buffer, 0, read); } return resultStream.ToArray(); } } #endregion }
++{{code language="Csharp" layout="LINENUMBERS"}}
++/// <summary>
++/// Helper class for compress en decompress of file data
++/// </summary>
++public static class ZipStreamHelper {
++  #region Compress and encode
++  /// <summary>
++  /// Comprimeer een string en geeft deze terug in Base64 string.
++  /// </summary>
++  /// <param name="content">filecontent</param>
++  /// <returns>gecomprimeerde string</returns>
++  public static string CompressToBase64String(string content) {
++    //string to byte[]
++    byte[] contentArray = stringToByteArray(content);
++    // Compress
++    byte[] compressed = Compress(contentArray);
++    return base64_encode(compressed);
++  }
++
++  /// <summary>
++  /// Zet een string om naar een ByteArray
++  /// </summary>
++  /// <param name="content">filecontent</param>
++  /// <returns>ByteArray</returns>
++  public static byte[] stringToByteArray(string content) {
++    System.Text.UTF8Encoding encoding = new System.Text.UTF8Encoding();
++    return encoding.GetBytes(content);
++  }
++
++  /// <summary>
++  /// comprimeer een ByteArray
++  /// </summary>
++  /// <param name="data">filedata als ByteArray</param>
++  /// <returns>gecomprimeerde ByteArray</returns>
++  public static byte[] Compress(byte[] data) {
++    using(var compressedStream = new MemoryStream())
++    using(var zipStream = new GZipStream(compressedStream, CompressionMode.Compress)) {
++      zipStream.Write(data, 0, data.Length);
++      zipStream.Close();
++      return compressedStream.ToArray();
++    }
++  }
++
++  /// <summary>
++  /// Zet een ByteArray om naar een Base64 string
++  /// </summary>
++  /// <param name="data">gecomprimeerde ByteArray</param>
++  /// <returns>Base 64 string</returns>
++  public static string base64_encode(byte[] data) {
++    if (data == null)
++      return string.Empty;
++    return Convert.ToBase64String(data);
++  }
++
++  /// <summary>
++  /// Zet een string om naar een Base64 string
++  /// </summary>
++  /// <param name="data">string</param>
++  /// <returns>Base 64 string</returns>
++  public static string string_base64_encode(string data) {
++    if (string.IsNullOrEmpty(data))
++      return string.Empty;
++
++    //string to byte[]
++    byte[] contentArray = stringToByteArray(data);
++    return base64_encode(contentArray);
++  }
++  #endregion
++
++  #region Decompress and decode
++  // Decode and decompress
++  /// <summary>
++  /// Decomprimeer een Base64 string naar een string
++  /// </summary>
++  /// <param name="contentBase64">GZIP Base64 string</param>
++  /// <returns>string</returns>
++  public static string DecompressBase64StringToString(string contentBase64) {
++    // Decompress
++    byte[] decoded = base64_decode(contentBase64);
++    byte[] decompressed = Decompress(decoded);
++
++    return byteArrayTostring(decompressed);
++  }
++
++  /// <summary>
++  /// Zet een ByteArray om in een normale string
++  /// </summary>
++  /// <param name="data">ByteArray</param>
++  /// <returns>string</returns>
++  public static string byteArrayTostring(byte[] data) {
++    System.Text.UTF8Encoding enc = new System.Text.UTF8Encoding();
++    return enc.GetString(data);
++  }
++
++  /// <summary>
++  /// Zet een Base64 string om naar een ByteArray
++  /// </summary>
++  /// <param name="encodedData">Base64 string</param>
++  /// <returns>gecomprimeerde ByteArray</returns>
++  public static byte[] base64_decode(string encodedData) {
++    byte[] encodedDataAsBytes = Convert.FromBase64String(encodedData);
++    return encodedDataAsBytes;
++  }
++
++  /// <summary>
++  /// Zet een gecomprimeerde ByteArray om in een ByteArray
++  /// </summary>
++  /// <param name="data">gecomprimeerde ByteArray</param>
++  /// <returns>ByteArray (gedecomprimeerd)</returns>
++  public static byte[] Decompress(byte[] data) {
++    using(var compressedStream = new MemoryStream(data))
++    using(var zipStream = new GZipStream(compressedStream, CompressionMode.Decompress))
++    using(var resultStream = new MemoryStream()) {
++      var buffer = new byte[4096];
++      int read;
++
++      while ((read = zipStream.Read(buffer, 0, buffer.Length)) > 0) {
++        resultStream.Write(buffer, 0, read);
++      }
++
++      return resultStream.ToArray();
++    }
++  }
++  #endregion
++}
++{{/code}}
  )))

Changes for page Download a project (export)

Summary

Details

Navigation