Commit Graph

7228 Commits

Author SHA1 Message Date
kezhenxu94 74cd559c47
Bump up infra e2e version and fix istio cases (#9529) 2022-08-27 11:45:34 +08:00
kezhenxu94 e1a5ee198f
Fix a duplicate config key and polish doc (#9521) 2022-08-25 20:00:08 +08:00
Fine0830 f8b89b78cd
sync ui (#9520) 2022-08-25 13:41:51 +08:00
Kirs ebe0078c34
Fix dependency license's NOTICE and binary jar included issues in the source release. (#9513) 2022-08-24 21:27:13 +08:00
Wan Kai 7df469a6e8
Fix JDBC TTL to delete additional tables data. (#9508) 2022-08-24 18:41:21 +08:00
pg.yang 1d930d0bb8
Update alarm doc introduce keys with data types of the configuration file. (#9514) 2022-08-24 07:31:30 +08:00
yswdqz 77ba2d553d
Sync UI (#9507) 2022-08-23 00:25:26 +08:00
Fine0830 2942af80ef
sync ui (#9505) 2022-08-22 22:15:33 +08:00
kezhenxu94 c8a78149a6
Enable otlp OC handler by default and polish doc (#9499) 2022-08-22 16:09:59 +08:00
yswdqz 828669ce2a
Support PostgreSQL monitoring. (#9495) 2022-08-22 14:29:26 +08:00
kezhenxu94 f96b3eacf1
Adapt OpenTelemetry native metrics protocol (#9497) 2022-08-21 21:13:23 +08:00
kezhenxu94 17968b6690
Bump up kubernetes java client to fix cve (#9498) 2022-08-21 19:32:34 +08:00
kezhenxu94 1377865f3e
Adopt license eye to check dependencies' license (#9220) 2022-08-21 18:31:38 +08:00
Tomasz Pytel 47a2d54779
AsyncPG, AIORedis Component-Server-Mappings (#9494) 2022-08-20 20:25:42 +08:00
kezhenxu94 e3d091ebd5
Add Kubernetes support module to share codes between modules and reduce calls to Kubernetes API server (#9493) 2022-08-20 15:24:44 +08:00
Tomasz Pytel dc30ded4cf
Add AsyncPG and AIORedis components for Python plugin (#9490)
* component IDs for AWS Lambda Functions plugins

* add AsyncPG and AIORedis components
2022-08-20 09:00:13 +08:00
吴晟 Wu Sheng ca5b378648
Polish readme a little (#9485) 2022-08-18 15:27:47 +08:00
mrproliu 1b38dd9526
Add Spring Sleuth dashboard to general service instance template (#9478) 2022-08-18 08:15:42 +08:00
Wan Kai aa8ddd2587
Optimize TTL mechanism for Elasticsearch storage, skip executed indices in one TTL rotation. (#9473)
* Optimize TTL mechanism for Elasticsearch storage, skip executed indices in one TTL rotation

* remove inspect
2022-08-16 12:41:43 +08:00
mrproliu 9e07ad7e9f
Fix query history process data failure (#9471) 2022-08-15 18:17:52 +08:00
Brandon Fergerson d1f898419b
feat: support sending alarm to discord (#9469) 2022-08-14 14:58:44 +08:00
Wan Kai 6ab00031a0
Fix query services by serviceId error when Elasticsearch storage `SW_STORAGE_ES_QUERY_MAX_SIZE` > 10000 (#9468) 2022-08-12 20:05:54 +08:00
yswdqz aa6c5e9182
Support MySQL monitoring. (#9432) 2022-08-12 16:51:36 +08:00
mrproliu 4c3010c97c
Fix MySQL related E2E failures (#9466) 2022-08-12 14:02:29 +08:00
pg.yang 29c4344bd3
Add component id for Micronaut HTTP plugin (#9455) 2022-08-10 22:49:12 +08:00
吴晟 Wu Sheng 7f21f2ee8a
Polish docs for sharding mode. (#9457) 2022-08-10 21:51:41 +08:00
Brandon Fergerson 5ba874a499
refactor: more consistent with other listener managers (#9445)
* refactor: make more consistent

* refactor: make more consistent

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-08-10 08:32:55 +04:00
吴晟 Wu Sheng b15bbecb73
Add an explanation doc for alerting kernel mechanism (#9446) 2022-08-09 22:39:29 +08:00
Wan Kai 8a8070025a
Support Elasticsearch column alias for the compatibility between storage logicSharding model and no-logicSharding model. (#9442)
## New ElasticSearch storage option explanation in 9.2.0
Since v9.2.0, SkyWalking OAP provides 2 storage options for metrics/meter and records, 
system environment variable is (`SW_STORAGE_ES_LOGIC_SHARDING`):

### No-Sharding Model (OAP default setting, `SW_STORAGE_ES_LOGIC_SHARDING = false`)
1. OAP merges all metrics/meter and records(without super datasets, such as segments) indices into one physical 
index template `metrics-all` and `records-all`.
2. The logic index name would be present in columns `metric_table` and `record_table`.
3. If the logic column name has an alias (configured by `@ElasticSearch.Column()`), the alias would be the real physical column name.

### No-Sharding Model (`SW_STORAGE_ES_LOGIC_SHARDING = true `)
1. OAP shard metrics/meter indices into multi-physical indices as in the previous versions(one index template per metric/meter aggregation function).
2. Records and metrics without configuring aggregation function in `@MetricsFunction` and `@MeterFunction` would not be sharded.
3. The shard template name would be `metrics-aggregation function name` or `meter-aggregation function name` such as `metrics-count`,
and the logic index name would be present in column `metric_table`.
4. The OAP **would not** use the column alias, the logic column name would be the real physical column name.

**Notice**: 
Users still could choose to adjust ElasticSearch's shard number(`SW_STORAGE_ES_INDEX_SHARDS_NUMBER`) to scale out no matter the option.
2022-08-09 22:24:45 +08:00
吴晟 Wu Sheng 053ae3f882
Fix #9440, `batchDAO.endOfFlush();` should be called after all executions are ready. (#9441) 2022-08-09 12:58:50 +08:00
Brandon Fergerson caa6a0de5a
refactor: make more consistent (#9439) 2022-08-09 10:27:20 +08:00
Brandon Fergerson 9e15a170e8
docs: improve grammar (#9438) 2022-08-09 08:35:03 +08:00
吴晟 Wu Sheng 174b8d6ef0
Enhance #9437 fix to avoid too many small flushing. (#9440)
Move the forcedly flush out of each worker's #flush, which would only make the left data flushing into the storage ASAP. In my previous fix, it would increase the number of flushing as the number of workers, which is unnecessary too.
2022-08-09 07:28:17 +08:00
吴晟 Wu Sheng 7f371ed565
[Critical] Fix a low performance issue of metrics persistent in ES (#9437)
[Critical] Fix a low-performance issue of metrics persistent in the ElasticSearch storage implementation. One single metric could have to wait for an unnecessary 7~10s(System Env Variable SW_STORAGE_ES_FLUSH_INTERVAL).

This is a solid and critical performance issue, from the self-observability metric, we could find one metric that would need 7-10s to execute the data flush, which is not expected.
2022-08-08 19:38:58 +08:00
Fine0830 fedc20991d
Sync ui: add a calculation to convert seconds to days (#9434) 2022-08-08 11:43:06 +08:00
Fine0830 93d2974cb5
sync ui (#9433) 2022-08-07 19:53:32 +08:00
mrproliu 0c2bf2c9ff
Support analyze the component in the eBPF Network profiling (#9430) 2022-08-06 23:32:14 +08:00
mrproliu 4bd4231b60
Elasticsearch storage support merge all records(without super datasets) indices into one physical index (#9424) 2022-08-05 10:40:33 +08:00
Wan Kai 85c09153b5
Fix Zipkin trace query the max size of spans (#9423) 2022-08-04 13:32:42 +08:00
Wan Kai 0a032ced18
Elasticsearch storage support merge all metrics/meter indices into one physical index (#9416) 2022-08-03 21:18:30 +08:00
StreamLang b21d511747
Add VIRTUAL_CACHE layer to fix Cache server icon in topology (#9414) 2022-08-01 13:48:05 +08:00
Fine0830 554c55457d
fix ui (#9408) 2022-07-29 21:20:11 +08:00
yswdqz f35a5c41ab
Add a new layer for MYSQL (#9407)
Layer==MySQL Server, also known as mysqld, is a single multithreaded program that does most of the work in a MySQL installation.
2022-07-29 20:10:52 +08:00
Fine0830 486a194b4f
sync ui (#9406) 2022-07-29 16:55:20 +08:00
mrproliu e26f63f3b9
Fix save metrics error when perform the network profiling (#9398) 2022-07-28 16:57:08 +08:00
mrproliu b8cf95d165
Add `SUM_PER_MIN`(sumHistogramPercentile) downsampling in MAL. Add eBPF Network Profiling E2E (#9377) 2022-07-28 10:00:36 +08:00
Wan Kai a00c68d471
Add log widget to general service root (#9393) 2022-07-28 08:39:36 +08:00
Fine0830 65110c3a75
sync ui (#9394) 2022-07-27 20:02:26 +08:00
Fine0830 cdfdf3cfaf
sync ui (#9391) 2022-07-27 16:59:45 +08:00
xiao ru xing 67bb7c4083
Fix typo in concepts and designs doc (#9385)
Signed-off-by: xiaorx <xiaorx@asiainfo.com>
2022-07-26 12:05:05 +08:00