Replicate MongoDB® Collections to SingleStore

Source Database Requirements

The replication feature uses MongoDB® change streams, and it works only with replica sets. A MongoDB® user must have the following roles (privileges) to replicate the collections in SingleStore:

• Read the admin database for the operation log (oplog)

• Read the config database in the configuration server

• listDatabases privilege

• Cluster-wide find and changeStream privileges

• Write permission to the singlestore database. The singlestore database is automatically created during the replication process.

You can provide the privileges or assign roles to the MongoDB® user using the MongoDB® Atlas UI or MongoDB® commands. For example:

• Using the UI for MongoDB® Atlas:

  1. On the MongoDB® Cloud dashboard, select Projects > <your_project>.

  2. In the left navigation pane, under Security, select Database Access.

  3. On the Database Users page, select Edit for the MongoDB® user used to connect to the MongoDB® instance.

  4. On the Edit User dialog, under Database User Privileges, select Specific Privileges > Add Specific Privilege.

  5. Add the following privileges:

     • readAnyDatabase

     • read for the config database

     • readWrite for the singlestore database

     

  6. Select Update User.

• Using MongoDB® commands for self-managed deployments: The following commands create a role and then assign the role to a user.

  MongoDB

  Copy

  db.adminCommand({ createRole: 'cdcRole', 
    privileges: [
      {'resource': {'cluster': true}, 'actions': ['find', 'changeStream']}
    ], 
    roles: [
      {'role': 'read', 'db': 'admin'},
      {'role': 'read', 'db': 'local'},
      {'role': 'read', 'db': 'config'},
      {'role': 'readWrite', 'db': 'singlestore'}
  ]})
  
  db.adminCommand({ createUser: 'cdcUser', 
    pwd: 's2mongoCDC12', 
    roles: ['cdcRole']
  })

  Refer to Database Commands for more information.

Allow Access to the MongoDB® Instance

To allow SingleStore to connect to your MongoDB® instance (MongoDB® Atlas or self-managed deployment), allow incoming traffic from the outbound IP addresses of your SingleStore Helios workspace group.

1. Copy the outbound IP address of your SingleStore Helios workspace.

   1. On the Cloud Portal, select Deployments > <your_workspace_group> > Firewall > Outbound.

   2. Copy all the IPs listed under IPs for Outbound Connections.

2. Allow incoming traffic to the MongoDB® instance from the SingleStore Helios outbound IP addresses. Follow the instructions for your deployment:

   • For MongoDB® Atlas deployments, add the outbound IPs to the MongoDB® IP Access List. Refer to Configure IP Access List Entries for related information.

   • For MongoDB® self-managed deployments, allow incoming traffic from the IP addresses. Refer to Network and Configuration Hardening for more information.