Is bi-directional CCR supported?

Plugins Cross-Cluster Replication
1

Hi all,

Would a bi-directional CCR setup as described in Bi-directional replication with Elasticsearch cross-cluster replication (CCR) | Elastic Blog work in opensearch ? And as follow-up question anybody have already experiences with it ?

Thx !

2 Likes
2

Haven’t tried myself but bi-directional CCR should work out of the box.

1 Like
3

Could you please point to the proper OpenSearch documentation to enable bi-directional CCR, if you already done with it? :slight_smile:

Or would be helpful if you can provide the steps to enable on AWS manager OpenSearch cluster.

4

Currently, we don’t have documentation for enabling bi-directional support for OpenSearch clusters.
Adding more details/caveats for this use-case,

  • During upgrades, you will have to severe connection on one direction and upgrade the clusters. This might result in pausing the replication flow for this duration.
1 Like
5

I have a bi-directional setup.
First cluster setting

{
  "persistent" : {
    "cluster" : {
      "remote" : {
        "connection-to-first" : {
          "seeds" : [
            "xxx:9300",
            "xxx:9300",
            "xxx:9300"
          ],
          "transport" : {
            "compress" : "true"
          }
        }
      },

Second cluster setting

{
  "persistent" : {
    "cluster" : {
      "remote" : {
        "connection-to-second" : {
          "seeds" : [
            "xxx:9300",
            "xxx:9300",
            "xxx:9300"
          ],
          "transport" : {
            "compress" : "true"
          }
        }
      },

I can sync from first 10 data-streams to second but I dont know why, I can sync only 2 data-streams from second to first.
I get this error.

{
  "error" : {
    "root_cause" : [
      {
        "type" : "illegal_state_exception",
        "reason" : "Timed out when waiting for persistent task after 30s"
      }
    ],
    "type" : "illegal_state_exception",
    "reason" : "Timed out when waiting for persistent task after 30s"
  },
  "status" : 500
}

when I stop replication from one data-stream I can add just one, and then again I get this error :confused:

6

There is no explicit support for replication of data streams. It is currently an open feature request: [FEATURE] Data Streams support for cross cluster replication · Issue #357 · opensearch-project/cross-cluster-replication · GitHub

1 Like