Chat now with support
Chat with Support

Identity Manager 8.2.1 - CSV Connector User Guide

Creating a synchronization project

A synchronization project collects all the information required for synchronizing the One Identity Manager database with a target system. Connection data for target systems, schema types and properties, mapping, and synchronization workflows all belong to this.

Have the following information available for setting up a synchronization project.

Table 5: Information required for setting up a synchronization project
Data Explanation

Synchronization server

All One Identity Manager Service actions are run against the target system environment on the synchronization server. Data entries required for synchronization and administration with the One Identity Manager database are processed by the synchronization server.

Installed components:

  • One Identity Manager Service (started)

The synchronization server must be declared as a Job server in One Identity Manager. The Job server name is required.

For more information, see Setting up the synchronization server.

Remote connection server

To configure synchronization with a target system, One Identity Manager must load the data from the target system. One Identity Manager communicates directly with the target system to do this. Sometimes direct access from the workstation, on which the Synchronization Editor is installed, is not possible. For example, because of the firewall configuration or the workstation does not fulfill the necessary hardware and software requirements. If direct access is not possible from the workstation, you can set up a remote connection.

The remote connection server and the workstation must be in the same Active Directory domain.

Remote connection server configuration:

  • One Identity Manager Service is started

  • RemoteConnectPlugin is installed

The remote connection server must be declared as a Job server in One Identity Manager. The Job server name is required.

TIP: The remote connection server requires the same configuration as the synchronization server (with regard to the installed software and entitlements). Use the synchronization as remote connection server at the same time, by simply installing the RemoteConnectPlugin as well.

For more detailed information about setting up a remote connection, see the One Identity Manager Target System Synchronization Reference Guide.

Synchronization workflow Set the Data import option in the synchronization step, if CSV import data is supplied by a secondary system. You cannot select the MarkAsOutstanding processing method for these synchronization steps.

For more detailed information about synchronizing user data with different systems, see the One Identity Manager Target System Synchronization Reference Guide.

Base object

You cannot normally specify a base object for synchronizing with the CSV connector. In this case, assignment of one base table and the synchronization server is sufficient.

  • Select the table from the Base table menu in which to import the objects. The base table can be used to defined downstream processes for synchronizing a CSV system. For more information about downstream processes, see the One Identity Manager Target System Synchronization Reference Guide.
  • The Synchronization servers menu displays all Job servers with an enabled CSV connector server function.
Variable set If you implement specialized variable sets, ensure that the start up configuration and the base object use the same variable set.

To configure synchronization with the CSV connector

  1. Create a new synchronization project.

  1. Add mappings. Define property mapping rules and object matching rules.

  2. Create synchronization workflows.

  3. Create a start up configuration.

  4. Define the synchronization scope.

  5. Specify the base object of the synchronization.

  6. Specify the extent of the synchronization log.

  7. Run a consistency check.

  8. Activate the synchronization project.

  9. Save the new synchronization project in the database.

Detailed information about this topic

Creating a synchronization project

There is a wizard to assist you with setting up a synchronization project. This wizard takes you through all the steps you need to set up initial synchronization with a target system. Click Next once you have entered all the data for a step.

NOTE: The following sequence describes how to configure a synchronization project if the Synchronization Editor is both:

  • Run in default mode

  • Started from the Launchpad

If you run the project wizard in expert mode or directly from the Synchronization Editor, additional configuration settings can be made. Follow the project wizard instructions through these steps.

To set up a synchronization project

  1. Start the Launchpad and log in on the One Identity Manager database.

    NOTE: If synchronization is run by an application server, connect the database through the application server.

  1. Select the CSV connector entry. Click Run.

    This starts the Synchronization Editor's project wizard.

  1. On the System access page, specify how One Identity Manager can access the target system.

    • If access is possible from the workstation on which you started the Synchronization Editor, do not change any settings.

    • If access is not possible from the workstation on which you started the Synchronization Editor, you can set up a remote connection.

      Enable the Connect using remote connection server option and select the server to be used for the connection under Job server.

  • Click Next to start the system connection wizard to create a connection to the CSV file.

  1. On the system connection wizard start page, select Create new CSV system.

  2. Select the CSV file whose data is to be synchronized in the file browser. Click Open.

  1. Check the values for coding the files and language on the Load CSV file page.
    Table 6: Properties of the CSV file
    Property Description
    Path Full path to CSV file.

    File encoding

    Encoding of the .csv file. Encoding of the character set is determined from the character set on your workstation when the import file is loaded. Change the setting if the file was created with another character set.

    Language

    Language used to create the file. The language is required in order to read local character formats correctly, for example, dates.

    Uniqueness violation behavior

    The CSV connector’s behavior if there are CSV entries that cannot be uniquely identified.

    • Throw error: Synchronization is canceled with an error message.

    • Take first: The first data set is synchronized. All other data sets are ignored.

    • Take last: The last data set is synchronized. All other data sets are ignored.

    • Take none: None of the data sets are synchronized.

    Read-only access Specifies whether the CSV connection has only read-only access to the CSV file.

    If this option is disabled, the CSV connector can also write data to the CSV file if the synchronization project is configured accordingly.

  2. Describe the CSV file structure on the File structure page.
    Table 7: File structure
    Property Description
    Number of lines in header The number of lines in the CSV file header. The header is not imported.
    Column names in line Row containing the column name.
    Columns identified by Indicator for column limits.
    • Select the Delimiter option if the data is separated by a semi-colon, comma, space, tab, pipe, or other character. Specify the line structure.

    • Select the Fixed width option if all the data in the columns has the same length. Specify the line structure.

  3. Describe the row structure in the CSV file on the Line structure page.
    1. If columns are separated by a delimiter, enter the delimiter.
      Table 8: Line structure
      Property Description

      Delimiter

      Delimiter used to separate the data in the file. You have the following options: Semicolon, Comma, Space, Tab, and Pipe.

      If the data is separated by a different character, select Other: and enter the delimiter in the input field next to the menu.

      Text delimiters

      Character enclosing the column text. This text is treated as one value on import, even is the text contains the delimiter given as above.

      NOTE: The delimiters are masked by doubling them up.

      Example:

      Delimiter: Comma (,)
      Text qualifier: Quotation mark (")
      Value in file: "Smith,Bill"
      Value after import: Smith,Bill
         
      Delimiter: Comma (,)
      Text qualifier: Not given or other character:
      Value in file: "Smith,Bill"
      1st value after import: "Smith
      2nd value after import: Bill"

      Mask delimiter by doubling

      Specifies whether the data is separated by several of the same delimiters. Data that contains a new line must be marked with a text qualifier.

      Example:

      Delimiter: Comma (,)
      Mask delimiter by doubling: Enabled
      Value in file: Smith,,Bill
      Value after import Smith,Bill
         
      Delimiter: Comma (,)
      Mask delimiter by doubling: Not set
      Value in file: Smith,,Bill
      1st value after import: Smith
      2nd value after import:  
      3rd value after import: Bill
    2. Specify the separation points if the columns are separated by a fixed width.
      • Click on the ruler to set a separation point. A separation mark is inserted.

      • When you click again on a fixed separation point, the separation mark is deleted.

  4. Describe the data structure on the Display information page.
    1. Specify the Display pattern with which the objects in Synchronization Editor are displayed. The display pattern is, for example, used in error messages or test result from object matching rules.
    2. Specify the following properties for each column.
      Table 9: Data structure of column
      Property Description
      Column Column name in the CSV file.

      Name

      The column’s technical name. Specify a new display name or copy the column name from the CSV file.

      Display name Name of the column for displaying in the Synchronization Editor. Specify a new display name or copy the column name from the CSV file.
      Description Text field for additional explanation.
      Hierarchical sort order

      Specify whether the column maps the path in an object hierarchy. Synchronization objects are sorted by this order. This makes it possible to resolve object dependencies.

      This option can only be set for one column of the CSV file.

      Example from the One Identity Manager scheme:

      The full name of a department (Department.FullPath) specifies the path in the department hierarchy (department with all higher-level departments). Objects are sorted by their full name during synchronization. All parent departments are loaded first during synchronization and then the child departments.

      Key column

      Specifies whether the column is used as a key column.

      More than one key columns can be defined. Data records should be uniquely identified with these key columns.

      Data type The column’s data type.

      MVP column

      Specifies whether the import contains a multi-value column (MVP). Specifies the delimiter for the individual values.

  1. On the Define CSV system file page, specify the name and repository of the CSV system file. The system connection configuration to the CSV file is saved in this file.

  2. On the past page of the system connection wizard you can add another CSV file to the system connection.

    • To add another CSV file to the system connection, click Add another CSV file.

    • Set the Save connection data on local computer option to save the connection data. This can be reused when you set up other synchronization projects.

    • Click Finish, to end the system connection wizard and return to the project wizard.

      NOTE: In the Synchronization Editor, the connection data is saved in a variable set and can be modified in the Configuration > Variables category if necessary.

  1. On the One Identity Manager Connection tab, test the data for connecting to the One Identity Manager database. The data is loaded from the connected database. Reenter the password.

    NOTE:

    • If you use an unencrypted One Identity Manager database and have not yet saved any synchronization projects to the database, you need to enter all connection data again.

    • This page is not shown if a synchronization project already exists.

  2. The wizard loads the target system schema. This may take a few minutes depending on the type of target system access and the size of the target system.

  1. On the Select project template page, select a project template to use for setting up the synchronization configuration.

    NOTE: The CSV connector does not provide a default project template for setting up synchronization. If you have created your own project template, you can select it to configure the synchronization project. Otherwise, select Create blank project.

  1. Enter the general setting for the synchronization project under General.

    Table 10: General properties of the synchronization project

    Property

    Description

    Display name

    Display name for the synchronization project.

    Description

    Text field for additional explanation.

  1. To close the project wizard, click Finish.

  2. Save the synchronization project in the database.

Customizing the CSV system file

The synchronization configuration must be changed if the CSV file schema changes. Changes are entered in the CSV system file. The CSV system file is edited in the system connection wizard. You can update the directory to the CSV files or CSV system file here.

Detailed information about this topic

Editing a CSV file schema

To add a new CSV file to a system connection and edit the CSV file schema

  1. Select the Configuration > Target system category.

  2. Click Edit connection.

    This starts the system connection wizard.

  3. On the Load CSV system file page, in the CSV system information view, specify the CSV files with which to set up the system connection.

  4. To add a new CSV file to the system connection, click . Then edit the schema for this file.

  5. To edit the schema for a CSV file, select the file and click .

  1. Check the values for coding the files and language on the Load CSV file page.
    Table 11: Properties of the CSV file
    Property Description
    Path Full path to CSV file.

    File encoding

    Encoding of the .csv file. Encoding of the character set is determined from the character set on your workstation when the import file is loaded. Change the setting if the file was created with another character set.

    Language

    Language used to create the file. The language is required in order to read local character formats correctly, for example, dates.

    Uniqueness violation behavior

    The CSV connector’s behavior if there are CSV entries that cannot be uniquely identified.

    • Throw error: Synchronization is canceled with an error message.

    • Take first: The first data set is synchronized. All other data sets are ignored.

    • Take last: The last data set is synchronized. All other data sets are ignored.

    • Take none: None of the data sets are synchronized.

    Read-only access Specifies whether the CSV connection has only read-only access to the CSV file.

    If this option is disabled, the CSV connector can also write data to the CSV file if the synchronization project is configured accordingly.

  2. Describe the CSV file structure on the File structure page.
    Table 12: File structure
    Property Description
    Number of lines in header The number of lines in the CSV file header. The header is not imported.
    Column names in line Row containing the column name.
    Columns identified by Indicator for column limits.
    • Select the Delimiter option if the data is separated by a semi-colon, comma, space, tab, pipe, or other character. Specify the line structure.

    • Select the Fixed width option if all the data in the columns has the same length. Specify the line structure.

  3. Describe the row structure in the CSV file on the Line structure page.
    1. If columns are separated by a delimiter, enter the delimiter.
      Table 13: Line structure
      Property Description

      Delimiter

      Delimiter used to separate the data in the file. You have the following options: Semicolon, Comma, Space, Tab, and Pipe.

      If the data is separated by a different character, select Other: and enter the delimiter in the input field next to the menu.

      Text delimiters

      Character enclosing the column text. This text is treated as one value on import, even is the text contains the delimiter given as above.

      NOTE: The delimiters are masked by doubling them up.

      Example:

      Delimiter: Comma (,)
      Text qualifier: Quotation mark (")
      Value in file: "Smith,Bill"
      Value after import: Smith,Bill
         
      Delimiter: Comma (,)
      Text qualifier: Not given or other character:
      Value in file: "Smith,Bill"
      1st value after import: "Smith
      2nd value after import: Bill"

      Mask delimiter by doubling

      Specifies whether the data is separated by several of the same delimiters. Data that contains a new line must be marked with a text qualifier.

      Example:

      Delimiter: Comma (,)
      Mask delimiter by doubling: Enabled
      Value in file: Smith,,Bill
      Value after import Smith,Bill
         
      Delimiter: Comma (,)
      Mask delimiter by doubling: Not set
      Value in file: Smith,,Bill
      1st value after import: Smith
      2nd value after import:  
      3rd value after import: Bill
    2. Specify the separation points if the columns are separated by a fixed width.
      • Click on the ruler to set a separation point. A separation mark is inserted.

      • When you click again on a fixed separation point, the separation mark is deleted.

  4. Describe the data structure on the Display information page.
    1. Specify the Display pattern with which the objects in Synchronization Editor are displayed. The display pattern is, for example, used in error messages or test result from object matching rules.
    2. Specify the following properties for each column.
      Table 14: Data structure of column
      Property Description
      Column Column name in the CSV file.

      Name

      The column’s technical name. Specify a new display name or copy the column name from the CSV file.

      Display name Name of the column for displaying in the Synchronization Editor. Specify a new display name or copy the column name from the CSV file.
      Description Text field for additional explanation.
      Hierarchical sort order

      Specify whether the column maps the path in an object hierarchy. Synchronization objects are sorted by this order. This makes it possible to resolve object dependencies.

      This option can only be set for one column of the CSV file.

      Example from the One Identity Manager scheme:

      The full name of a department (Department.FullPath) specifies the path in the department hierarchy (department with all higher-level departments). Objects are sorted by their full name during synchronization. All parent departments are loaded first during synchronization and then the child departments.

      Key column

      Specifies whether the column is used as a key column.

      More than one key columns can be defined. Data records should be uniquely identified with these key columns.

      Data type The column’s data type.

      MVP column

      Specifies whether the import contains a multi-value column (MVP). Specifies the delimiter for the individual values.

  1. On the past page of the system connection wizard you can add another CSV file to the system connection.

    • To add another CSV file to the system connection, click Add another CSV file.

    • Click Finish to end the system connection wizard.
  2. Select the General view and click Update schema.

  3. Confirm the security prompt with Yes.
  4. This reloads the schema data.

  5. Save the changes.
Related topics
Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating