Commit Graph

168 Commits

Author SHA1 Message Date
kezhenxu94 6bb4d35ce8
Add all agent config to `agent.conf` file for convenient containerization use cases (#7470)
* Add all agent config to `agent.conf` file for convenient containerization use cases

* Fix name and default value
2021-08-18 10:25:28 +08:00
hailin0 ce45397c56
Fix kafka-reporter-plugin shade package conflict (#7463)
* Fix kafka-reporter-plugin shade package conflict

Don't shade lz4, snappy or zstd package because they call native library files.
2021-08-15 21:55:45 +08:00
吴晟 Wu Sheng 6a241aed75
[Break Change] Remove endpoint name in backend log and browser log query (#7444)
* Remove page path in the browser log query condition.

* Remove endpoint name in the backend log query condition.
2021-08-12 09:44:19 +08:00
kezhenxu94 85e22f5124
Fix issues in ES7.14 and add log cases to ES7.14 (#7429) 2021-08-10 15:36:53 +08:00
wankai123 4e7d80fb88
Support Metric level function `serviceRelation` in `MAL` and binding envoy metrics into the topology. (#7399)
* Support Metric level function `serviceRelation` in `MAL`.
* Support envoy metrics binding into the topology.
* add istio args
* remove istio 1.7

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: Jared Tan <jian.tan@daocloud.io>
Co-authored-by: Zhenxu <kezhenxu94@apache.org>
2021-08-06 17:09:13 +08:00
吴晟 Wu Sheng b903bf17a0
Add ElasticSearch 7.14 to test and bump up OpenSearch version to 1.0 GA (#7415) 2021-08-06 10:36:45 +08:00
Switch 68e699550d
Add Thread and ClassLoader Metrics for the self-observability and otel-oc-rules (#7367)
* Add Thread and ClassLoader Metrics for the self-observability

* update CHANGES.md

* update OC receiver MAL settings
2021-07-25 07:32:03 +08:00
wankai123 9f3ff517d1
Support envoy cluster manager metrics (#7294) 2021-07-16 15:35:48 +08:00
Fine0830 ff7c8fa87e
feat: update e2e for client-js (#7297) 2021-07-14 21:43:27 +08:00
吴晟 Wu Sheng de975c7e2b
Remove synchronous persistence mechanism in API level and ElasticSearch implementation (#7293)
* Performance: remove the synchronous persistence mechanism from batch ElasticSearch DAO. Because the current enhanced persistent session mechanism, don't require the data queryable immediately after the insert and update anymore.
* Performance: share `flushInterval` setting for both metrics and record data, due to `synchronous persistence mechanism` removed. Record flush interval used to be hardcoded as 10s.
* Remove `syncBulkActions` in ElasticSearch storage option.
* Increase the default bulkActions(env, SW_STORAGE_ES_BULK_ACTIONS) to 5000(from 1000).
* Increase the flush interval of ElasticSearch indices to 15s(from 10s)

Add these 2 references. According to these, **(same _index, _type and _id) in same bulk will be in order**
1. https://github.com/elastic/elasticsearch/issues/50199
2. https://discuss.elastic.co/t/order-of--bulk-request-operations/98124

Notice, the order of different bulks is not guaranteed by the ElasticSearch cluster. We are going to have the risk of dirty write. But consider we set over 20s period between flush, and index flush period is 10, we should be safe.

Recommend 5000 bulk size and 15s flush interval only. The persistent period has been set to 25s.
2021-07-14 17:19:49 +08:00
kezhenxu94 d79094c178
Add pagination to event query (#7274) 2021-07-09 23:04:50 +08:00
kezhenxu94 fd92f4678a
perf: optimize Groovy-based LAL DSL with static compilation (#7263)
Groovy naturally supports many dynamic features that we don't benefit for now but cost performance loss, in this patch we compile our Groovy-based DSL scripts statically to optimize performance.
2021-07-09 18:00:25 +08:00
Fine0830 f9140b80fa
test: update commitID (#7255) 2021-07-07 17:46:29 +08:00
Switch 4067fba2ab
Add some new thread metric and class metric to JVMMetric (#7230) (#7243) 2021-07-07 16:30:55 +08:00
Jared Tan 0efc733901
Replace zuul proxy with spring cloud gateway 2.x. in webapp module. (#7220) 2021-07-04 10:24:56 +08:00
kezhenxu94 ab6285c5a4
Add JDK 16 to test matrix, move bom to backend profile (#7139) 2021-06-20 23:24:02 +08:00
kezhenxu94 6caf29733f
Add FluentBit integration E2E test and doc (#7138) 2021-06-20 21:56:45 +08:00
Ax1an 402902f75c
Agent supports the collection of JVM arguments and jar dependencies information. (#7069) 2021-06-17 15:30:44 +08:00
liqiangz 7a3355f956
Use MAL to calculate JVM metrics, remove OAL dependency. (#7091) 2021-06-11 22:21:10 +08:00
吴晟 Wu Sheng 122946e099
Use go2sky 1.1.0 for e2e testing. (#7034) 2021-05-28 15:37:29 +08:00
Zhenxu f742142ca3
Add UI templates (#7013) 2021-05-28 14:35:27 +08:00
hailin0 47fef5df22
Support native-json format log in kafka-fetcher-plugin (#6952) 2021-05-20 16:33:44 +08:00
chen~ bb590daba9
Include event(s) to alarms. (#6888)
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-05-19 14:14:48 +08:00
Zhenxu Ke 15e112262c
Replace OpenSearch self-built docker image with official one (#6938) 2021-05-14 19:24:23 +08:00
Zhenxu Ke c5e0c01f06
Add OpenSearch as a storage option (#6916) 2021-05-09 10:09:15 +08:00
Zhenxu Ke 3b15f8d132
feature: Envoy access log receiver supports TCP logs (#6727) 2021-05-07 07:50:03 +08:00
Qiuxia Fan 77ef3da8e9
Update commit hash for browser agent (#6812) 2021-04-25 18:19:23 +08:00
liqiangz 7a53331367
Support alarm tags (#6820) 2021-04-25 17:22:43 +08:00
吴晟 Wu Sheng eba7a5f940
Sync all submodules. (#6777) 2021-04-17 18:40:53 +08:00
Zhenxu Ke 35c7fa5ed6
Pin the tidb docker image to 4.0.12 (#6716) 2021-04-09 09:24:36 +08:00
吴晟 Wu Sheng c2c62620ff
Update Dockerfile.go (#6689) 2021-04-06 07:44:43 +08:00
Gao Hongtao 7d06c210ae
Resolve envoy service name from a different position (#6654) 2021-03-31 12:09:18 +08:00
Zhenxu Ke db9cc26977
Remove binary files and download them in CI process instead (#6631) 2021-03-28 18:37:33 +08:00
mrproliu fdab7f06a1
Add go2sky correlation context E2E test (#6590) 2021-03-22 20:25:37 +08:00
Daming c2fa8baf5c
Improvement lua e2e case (#6553) 2021-03-16 13:34:17 +08:00
hailin0 0382447749
Fix tags store of log and trace on h2/mysql/pg storage (#6505) 2021-03-11 10:40:54 +08:00
hailin0 78487ad983
Upgrade lombok to 1.18.16 (#6506) 2021-03-07 18:54:45 +08:00
Zhenxu Ke cb16e524da
Enhance the LAL to allow easily skipping logs with malformed formats (#6477) 2021-03-03 17:18:50 +08:00
Zhenxu Ke de6a731d72
Save Envoy http access logs when error occurs (#6322) 2021-03-02 22:40:30 +08:00
Zhenxu Ke 77082de77b
Add `sum` function in meter system (#6427)
* Add `sum` function in meter system

* Fix minor potential bug and reformat some codes

* Fix a bug

* Use Set to hold the {aggregate,scope} labels as same labels maybe added by multiple aggregation functions

* Separate downsampling function and revert unnecessary codes
2021-02-25 15:10:28 +08:00
Zhenxu Ke 96f1c12159
Introduce log analysis language (LAL) (#6388) 2021-02-23 20:06:48 +08:00
Daming 1d4ff66719
Update Dockerfile.nginx (#6421) 2021-02-23 12:09:46 +08:00
zhang-wei 1c52995cbf
Supplement the E2E test for skywalking-client-js (#6409) 2021-02-21 22:29:50 +08:00
Zhenxu Ke 9de93119e2
Enhance gRPC log appender to allow layout pattern (#6403) 2021-02-21 12:53:44 +08:00
mrproliu 317a6580f3
Remove filename suffix in the meter active file config (#6413) 2021-02-21 08:35:38 +08:00
haoyann c45bb361ee
Storage plugin supports PostgreSQL (#6345) 2021-02-20 20:59:51 +08:00
wankai123 6c6a8a7109
Add E2E test for VM monitoring that the metrics from Promethues node-exporter via OTEL. (#6404) 2021-02-20 16:11:44 +08:00
mrproliu e60950c5c3
Change the Zabbix receiver is disabled by default (#6395) 2021-02-18 23:45:18 +08:00
Evan ecd0213587
Fix the incorrect package imports of the log4j grpc log appender. (#6385) 2021-02-17 17:27:26 +08:00
mrproliu 75f03acba7
Adopt Zabbix protocol (#6176)
Happy Chinese New Year !!
2021-02-10 22:40:07 +08:00