Commit Graph

6776 Commits

Author SHA1 Message Date
吴晟 Wu Sheng f32d3d0720
Enhance the storage session mechanism (#7221) 2021-07-01 23:25:52 +08:00
Jing da5af095ab
Fix bug with error topic in kafka fetcher md. (#7223) 2021-07-01 21:06:41 +08:00
CharliePu 27e59868f4
sync ui and update CHANGES log (#7205) 2021-07-01 15:23:55 +08:00
hn abd36dfc94
fix some method exception error (#7210) 2021-07-01 10:59:03 +08:00
吴晟 Wu Sheng 536b7d2328
Support connectTimeout and socketTimeout settings (#7214) 2021-07-01 08:20:59 +08:00
吴伟杰 0975809e43
Add an agent plugin for ShardingSphere 5.0.0-beta (#7171) 2021-06-30 21:00:20 +08:00
kezhenxu94 dcefc69edf
Doc: update doc to declare that zookeeper 3.5+ is required in cluster coordinator (#7212) 2021-06-30 19:21:02 +08:00
吴晟 Wu Sheng 50a0bcbf73
Optimize L1 aggregation, enhance gRPC client between L1 and L2 aggregation. (#7206)
1.0Performance: Add L1 aggregation flush period, which reduces the CPU load and helps young GC.

2. Replace do not direct send after the first aggregation to reduce the network #6400.

3. Enhance the DataCarrier to notify the consumer in no enqueue event in short term.

4. L1 aggregation flush period still works even no further metrics generated, powered by <3>

5. Fix gRPC remote client OOM. The concurrency control mechanism failed.
2021-06-30 19:14:20 +08:00
吴晟 Wu Sheng 4374fac4cb
Fix broken image path for mssql server in testing. (#7211) 2021-06-30 17:55:38 +08:00
吴晟 Wu Sheng 89549c0183
Fix the queue initial size is not set by max batch size accordingly (#7204) 2021-06-30 11:33:07 +08:00
吴晟 Wu Sheng 16ebaade6a
Optimize IDs reading in the persistent worker. (#7193)
* Optimize IDs reading in the persistent worker.
2021-06-30 10:17:46 +08:00
kezhenxu94 f5b7c3e32d
Perf: cache metrics id and entity id (#7201)
There are a lot of calls to `Metrics.id()` and `ISource.getEntityId`, which calculates the id by manipulating strings in every single call, producing many garbage objects.

In this patch, I cache the id and only calculate the id if it's requested for the first time.
2021-06-29 22:48:51 +08:00
kezhenxu94 84a7fe30c8
Perf: cache regex pattern and result, optimize string concatenation (#7199)
The possible metrics names are relatively fixed in an OAP run, we previously always escape the metrics names, building a new regex Pattern from scratch, which is cpu-consuming.

In this patch, I cache the escaped metrics names, and if it missed, use a pre-compiled regex Pattern to escape the metrics name.

This patch also replace string concatenation `+` with `StringBuilder` in generated classes, which won't get optimized by Java compiler

This may reduce 1~1.5 vCPU under 20K RPS environment.
2021-06-29 17:46:42 +08:00
zhyyu b8fadec033
fix slow db dynamic config bug (#7192) 2021-06-29 16:41:01 +08:00
Alvin a966eea35c
Support prepare and save metrics concurrency (#7153) 2021-06-29 14:34:29 +08:00
kezhenxu94 de1d0461cc
perf: trim useless metadata fields in ALS to improve performance (#7191)
These fields in `stateMap` metadata are not used by `metadata-service-mapping.yaml` now and there is low possibility that they may be used in real case, but, they cost a lot to deserialize, so we remove them to improve performance

From what I've tested, the analyzer can process 250k ALS logs before trimming the fields and can process 420k ALS logs after trimming the fields
2021-06-28 22:18:14 +08:00
liqiangz d63f3ffcc1
revert #7091 (#7189) 2021-06-28 21:05:28 +08:00
Fine0830 273bc5bc0b
Sync UI (#7187) 2021-06-28 18:58:34 +08:00
844067874 e1aad420db
fix the response time of gRPC is not right. (#7179) 2021-06-28 18:55:27 +08:00
kezhenxu94 e7bc81abbb
Perf: optimize Envoy ALS analyzer performance in high traffic load scenario (reduce ~1cpu in ~10k RPS) (#7182) 2021-06-27 17:56:59 +08:00
wankai123 e95064d976
chore: set openAPI grouping CoreModuleConfig default value consistent with application.yaml, add re-benchmark result (#7176) 2021-06-26 00:08:14 +08:00
Daming d8a5e8c15b
eliminate `now` error at a fixed rate schedule executor (#7145) 2021-06-24 09:24:48 +08:00
tangxqa 3541c32530
Update agent.config (#7163) 2021-06-23 16:43:39 +08:00
Fine0830 d6f21a9562
Sync UI (#7160) 2021-06-23 09:53:06 +08:00
Tomasz Pytel 8a25ac6229
Python celery plugin (#7159) 2021-06-22 22:05:33 +08:00
wallezhang 1bc69370bf
feat: add neo4j-4.x-plugin (#7099) 2021-06-22 15:36:51 +08:00
吴晟 Wu Sheng 09944e00a9
Update log-analyzer.md (#7141) 2021-06-21 10:36:37 +08:00
吴晟 Wu Sheng 02c572a3db
Polish log doc (#7140) 2021-06-21 09:33:44 +08:00
kezhenxu94 ab6285c5a4
Add JDK 16 to test matrix, move bom to backend profile (#7139) 2021-06-20 23:24:02 +08:00
kezhenxu94 6caf29733f
Add FluentBit integration E2E test and doc (#7138) 2021-06-20 21:56:45 +08:00
kezhenxu94 3536b3c1c4
Extract dependency management to a bom (#7136) 2021-06-20 20:57:26 +08:00
吴晟 Wu Sheng ed4310920a
Reorganize document menu. (#7137) 2021-06-20 14:13:46 +08:00
wankai123 19a068d708
Feature: support endpoint name grouping by OpenAPI definitions. (#7130) 2021-06-20 07:57:10 +08:00
kezhenxu94 528ee6de40
OAL supports generating metrics from events (#7134)
* OAL supports generating metrics from events

* Add new dashboard for event metrics

* Add some docs for event metrics
2021-06-19 20:20:37 +08:00
kezhenxu94 edf6fccf9c
Upgrade commons-lang3 to avoid potential NPE in some JDK versions (#7133) 2021-06-18 21:18:05 +08:00
吴晟 Wu Sheng e21cb196fc
Remove deprecated nameResolverFactory method. (#7132) 2021-06-18 20:14:51 +08:00
zhyyu 4698681e7c
Support authentication for log report channel. (#7131) 2021-06-18 16:09:55 +08:00
Ax1an 402902f75c
Agent supports the collection of JVM arguments and jar dependencies information. (#7069) 2021-06-17 15:30:44 +08:00
Tomasz Pytel 76b3bece2b
add component id for python Psycopg -> PostgreSQL (#7125) 2021-06-17 06:30:52 +08:00
吴晟 Wu Sheng 2dd5eea56e
Fix markdown format issue. (#7123) 2021-06-16 13:46:58 +08:00
Gao Hongtao 669fe1593c
Upgrade OAP dependencies (#7119)
* Introduce trivy to scan images

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Fix CVE

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update licenses

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Remove log4j 1.x

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update CHANGES.md

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

* Update LICENSE refer to webapp

Signed-off-by: Gao Hongtao <hanahmily@gmail.com>

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-06-16 12:14:39 +08:00
kezhenxu94 9b6c0d1b23
chore: for scheduled tasks, only run on main repo not fork repos (#7121) 2021-06-15 23:49:08 +08:00
Zhenxu efcb396f73
Only count 5xx as error in Envoy ALS receiver (#7111) 2021-06-12 07:09:48 +08:00
liqiangz 7a3355f956
Use MAL to calculate JVM metrics, remove OAL dependency. (#7091) 2021-06-11 22:21:10 +08:00
mrproliu 553dd7c061
Disable spring sleuth analyzer by default (#7106) 2021-06-11 16:59:57 +08:00
xdRight eace27e4ee
Fix doc bug (#7093) (#7098) 2021-06-10 17:01:50 +08:00
Zhenxu f0d5c7dfd3
Fix dead link (#7094) 2021-06-10 13:17:01 +08:00
wallezhang 1c5dab8463
refactor: EntrySpan and ExitSpan support modifying attributes in async mode (#7086) 2021-06-10 13:11:00 +08:00
Wing 8258407b7a
Refine backend doc (#7092) 2021-06-10 08:50:51 +08:00
Gao Hongtao ca155dee05
Upgrade several old dependencies (#7090) 2021-06-10 08:35:31 +08:00