XML format in Data Factory in Microsoft Fabric

This article outlines how to configure XML format in the data pipeline of Data Factory in Microsoft Fabric.

Supported capabilities

XML format is supported for the following activities and connectors as source.

XML format in copy activity

To configure XML format, choose your connection in the source of data pipeline copy activity, and then select XML in the drop-down list of File format. Select Settings for further configuration of this format.

XML as source

After you select Settings in the File format section, the following properties are shown in the pop-up File format settings dialog box.

• Compression type: The compression codec used to read XML files. You can choose from None, bzip2, gzip, deflate, ZipDeflate, TarGZip or tar type in the drop-down list.

  If you select ZipDeflate as the compression type, Preserve zip file name as folder is displayed under the Advanced settings in the Source tab.

  • Preserve zip file name as folder: Indicates whether to preserve the source zip file name as a folder structure during copy.
    • If this box is checked (default), the service writes unzipped files to <specified file path>/<folder named as source zip file>/.
    • If this box is unchecked, the service writes unzipped files directly to <specified file path>. Make sure you don't have duplicated file names in different source zip files to avoid racing or unexpected behavior.

  If you select TarGZip/tar as the compression type, Preserve compression file name as folder is displayed under the Advanced settings in the Source tab.

  • Preserve compression file name as folder: Indicates whether to preserve the source compressed file name as a folder structure during copy.
    • If this box is checked (default), the service writes decompressed files to <specified file path>/<folder named as source compressed file>/.
    • If this box is unchecked, the service writes decompressed files directly to <specified file path>. Make sure you don't have duplicated file names in different source files to avoid racing or unexpected behavior.

• Compression level: Specify the compression ratio when you select a compression type. You can choose from Fastest or Optimal.

  • Fastest: The compression operation should complete as quickly as possible, even if the resulting file is not optimally compressed.
  • Optimal: The compression operation should be optimally compressed, even if the operation takes a longer time to complete. For more information, see Compression Level topic.

• Encoding: Specify the encoding type used to write test files. Select one type from the drop-down list. The default value is UTF-8.

• Null value: Specifies the string representation of null value. The default value is empty string.

Under Advanced settings in the Source tab, the following XML format related properties are displayed.

• Validation mode: Specifies whether to validate the XML schema. Select one mode from the drop-down list.

  • None: Select this to not use validation mode.
  • xsd: Select this to validate the XML schema using XSD.
  • dtd: Select this to validate the XML schema using DTD.

  

• Namespaces: Specify whether to enable namespace when parsing the XML files. It is selected by default.

• Namespace prefix pairs: If the Namespaces is enabled, selecting + New and specify the URL and Prefix. You can add more pairs by selecting + New.
  Namespace URI to prefix mapping is used to name fields when parsing the XML file. If an XML file has namespace and namespace is enabled, by default, the field name is the same as it is in the XML document. If there is an item defined for the namespace URI in this map, the field name is prefix:fieldName.

  

• Detect data type: Specify whether to detect integer, double, and Boolean data types. It is selected by default.

Table summary

XML as source

The following properties are supported in the copy activity Source section when using XML format.

Related content

• Connectors overview