skywalking-java/docs/en/setup/backend
吴晟 Wu Sheng de975c7e2b
Remove synchronous persistence mechanism in API level and ElasticSearch implementation (#7293)
* Performance: remove the synchronous persistence mechanism from batch ElasticSearch DAO. Because the current enhanced persistent session mechanism, don't require the data queryable immediately after the insert and update anymore.
* Performance: share `flushInterval` setting for both metrics and record data, due to `synchronous persistence mechanism` removed. Record flush interval used to be hardcoded as 10s.
* Remove `syncBulkActions` in ElasticSearch storage option.
* Increase the default bulkActions(env, SW_STORAGE_ES_BULK_ACTIONS) to 5000(from 1000).
* Increase the flush interval of ElasticSearch indices to 15s(from 10s)

Add these 2 references. According to these, **(same _index, _type and _id) in same bulk will be in order**
1. https://github.com/elastic/elasticsearch/issues/50199
2. https://discuss.elastic.co/t/order-of--bulk-request-operations/98124

Notice, the order of different bulks is not guaranteed by the ElasticSearch cluster. We are going to have the risk of dirty write. But consider we set over 20s period between flush, and index flush period is 10, we should be safe.

Recommend 5000 bulk size and 15s flush interval only. The persistent period has been set to 25s.
2021-07-14 17:19:49 +08:00
..
advanced-deployment.md Refine backend (#6972) 2021-05-20 06:25:52 +08:00
apdex-threshold.md Refine backend (#6972) 2021-05-20 06:25:52 +08:00
backend-alarm.md Add missing doc for events alarm metrics name (#7029) 2021-05-27 21:07:40 +08:00
backend-cluster.md Upgrade etcd cluster coordinator and dynamic configuration to v3.x (#7215) 2021-07-05 11:23:11 +08:00
backend-fetcher.md Fix bug with error topic in kafka fetcher md. (#7223) 2021-07-01 21:06:41 +08:00
backend-health-check.md Reorganize document menu. (#7137) 2021-06-20 14:13:46 +08:00
backend-infrastructure-monitoring.md Refine backend (#2) (#7056) 2021-06-02 15:32:11 +08:00
backend-init-mode.md Refine backend (#1) (#7031) 2021-05-28 07:07:30 +08:00
backend-ip-port.md Refine backend (#1) (#7031) 2021-05-28 07:07:30 +08:00
backend-k8s.md Reorganize document menu. (#7137) 2021-06-20 14:13:46 +08:00
backend-meter.md Disable spring sleuth analyzer by default (#7106) 2021-06-11 16:59:57 +08:00
backend-receivers.md Disable spring sleuth analyzer by default (#7106) 2021-06-11 16:59:57 +08:00
backend-setting-override.md Refine backend doc (#7092) 2021-06-10 08:50:51 +08:00
backend-setup.md Reorganize document menu. (#7137) 2021-06-20 14:13:46 +08:00
backend-start-up-mode.md Provide two start up modes and documents. (#2116) 2019-01-03 15:19:45 +08:00
backend-storage.md Add OpenSearch as a storage option (#6916) 2021-05-09 10:09:15 +08:00
backend-telemetry.md Reorganize document menu. (#7137) 2021-06-20 14:13:46 +08:00
backend-token-auth.md add token authentication between agent and oap receiver. (#4197) 2020-01-12 23:08:39 +08:00
backend-zabbix.md Adopt Zabbix protocol (#6176) 2021-02-10 22:40:07 +08:00
configuration-vocabulary.md Remove synchronous persistence mechanism in API level and ElasticSearch implementation (#7293) 2021-07-14 17:19:49 +08:00
dynamic-config.md Upgrade etcd cluster coordinator and dynamic configuration to v3.x (#7215) 2021-07-05 11:23:11 +08:00
endpoint-grouping-rules.md Feature: support endpoint name grouping by OpenAPI definitions. (#7130) 2021-06-20 07:57:10 +08:00
grafana-cluster.json Fix negative number on the grafana dashboard. (#6615) 2021-03-24 21:02:37 +08:00
grafana-instance.json Fix negative number on the grafana dashboard. (#6615) 2021-03-24 21:02:37 +08:00
grpc-ssl.md Hot reload gRPC certs of OAP. (#5376) 2020-08-31 23:11:01 +08:00
log-analyzer.md Update log-analyzer.md (#7141) 2021-06-21 10:36:37 +08:00
metrics-exporter.md Enhance the export service. (#6602) 2021-03-24 09:22:03 +08:00
otel-collector-config.yaml Doc: Polish k8s monitoring otel-collector configuration example. (#6722) 2021-04-10 06:34:11 +08:00
service-auto-grouping.md Support group in the service traffic and service list query. (#5851) 2020-11-17 22:45:32 +08:00
slow-db-statement.md Provide slow database rule document. (#2253) 2019-02-18 21:23:36 +08:00
spring-sleuth-setup.md Disable spring sleuth analyzer by default (#7106) 2021-06-11 16:59:57 +08:00
trace-sampling.md correct the doc of backend trace sampling with the latest configuration (#6085) 2020-12-26 19:10:42 +08:00
ttl.md Fix config file and document typo for ttl (#5087) (#5088) 2020-07-12 17:36:35 +08:00
ui-setup.md Replace zuul proxy with spring cloud gateway 2.x. in webapp module. (#7220) 2021-07-04 10:24:56 +08:00
uninstrumented-gateways.md Support gateway without agent (#3308) 2019-08-30 16:17:41 +08:00