Commit Graph

1994 Commits

Author SHA1 Message Date
寻找的人 2603d2bd17
Add component ID(158) for the Solon framework (#12347) 2024-06-20 14:20:05 +08:00
Wan Kai 0b7272d813
Support trace MQE query for debugging. (#12342) 2024-06-18 16:58:03 +08:00
yswdqz bef9eec44b
[Feature] Support to query relation metrics through PromQL. (#12316) 2024-06-16 14:46:22 +08:00
Wan Kai a6c7c71663
Increase `SW_CORE_GRPC_MAX_MESSAGE_SIZE` to 50MB and e2e bump up the version of the opentelemetry-collector to 0.102.1. (#12321) 2024-06-11 21:14:36 +08:00
吴晟 Wu Sheng caeaec6387
Remove unnecessary BanyanDB flushing logs(info). (#12319) 2024-06-11 12:41:43 +08:00
Starry 905e0a994f
Add Golang as a supported language for Elasticsearch (#12315) 2024-06-11 08:25:21 +08:00
mrproliu 0b175ffb0a
Adding eBPF Access Log Feature E2E and support exclude specific namespaces traffic (#12304) 2024-06-06 13:50:10 +08:00
mrproliu 341bdcf1dd
Fix wrong indices in the eBPF Profiling related models (#12297) 2024-06-05 15:52:45 +08:00
吴晟 Wu Sheng 46eaa67da1
Sync query protocol submodule (#12269) 2024-05-30 10:12:30 +08:00
Gao Hongtao b21e576a30
Fix Wrong Interval in BanyanDB Installation Process (#12264) 2024-05-29 23:52:13 +08:00
Chen Ziyan 14c5778f57
Add component library IDs of Derby/Sybase/SQLite/DB2/OceanBase jdbc driver (#12208) 2024-05-11 11:51:30 +08:00
weixiang1862 19fba2dae8
Fix LAL test query api. (#12206) 2024-05-10 16:47:24 +08:00
吴晟 Wu Sheng 054d0e4ff9
Release 10.0.0 and move forward to 10.1.0 (#12203) 2024-05-10 09:19:56 +08:00
吴晟 Wu Sheng 045e2c8dda
Fix submodule commit ID. (#12204) 2024-05-10 07:19:06 +08:00
Gao Hongtao 28bf55219f
Bump BanyanDB Java Client to 0.6.0 (#12195) 2024-05-09 17:31:52 +08:00
Wan Kai b3044ee714
MQE support `sort_values` and `sort_label_values` functions. (#12193)
* MQE support `sort_values` and `sort_label_values` functions.

* sync UI.
2024-05-07 16:42:14 +08:00
Starry a63601318d
Fix inaccurate Pulsar and Bookkeeper metrics (#12174) 2024-05-01 14:53:33 +08:00
Wan Kai 59cabc10a2
fix typo (#12176) 2024-04-30 11:16:58 +08:00
Wan Kai a38628fced
Fix MQE `top_n` global query. (#12163) 2024-04-26 14:53:37 +08:00
Chen Ziyan 9b2cca9b46
add C3P0 in component-libraries.yml (#12162) 2024-04-26 07:53:12 +08:00
Wan Kai fe2c4b5f3f
[Break Change] gGRPC metrics exporter unified the metric value type and support labeled metrics. (#12156) 2024-04-24 14:29:13 +08:00
yswdqz 2d6bc69adb
Optimize OTEL metrics attributes KV convert. (#12152) 2024-04-24 11:32:34 +08:00
yswdqz 86155bef81
Fix inaccurate MySQL/MariaDB, Redis metrics (#12130) 2024-04-22 15:44:12 +08:00
Harry e9a2ed2c03
fix inaccurate Hierarchy of RabbitMQ metrics. (#12144) 2024-04-22 14:55:13 +08:00
Wan Kai 5808627227
* MQE query: make metadata not return `null`. (#12142)
* MQE labeled metrics Binary Operation: return empty value if the labels not match rather than report error.
2024-04-22 12:25:12 +08:00
weixiang1862 d6fc848e8b
Calculate Nginx service HTTP Latency by MQE. (#12136) 2024-04-19 19:12:36 +08:00
Chen Ziyan 7e978261fc
Add ActiveMQ classic monitoring (#12109) 2024-04-18 12:32:59 +08:00
weixiang1862 d71f858f2f
Fix inaccurate MongoDB Metrics & Add label for complex MQE in Nginx dashboard. (#12126) 2024-04-18 11:11:20 +08:00
Wan Kai 630d54d963
Fix hierarchy matching rule and add hierarchy env config and sync UI (#12120) 2024-04-17 12:35:16 +08:00
pg.yang bea7ed3f4a
Fix inaccurate APISIX metrics (#12108) 2024-04-16 17:39:37 +08:00
Wan Kai 0b9bbb47b3
Clean the unused elements in the UI-templates. (#12111) 2024-04-16 12:03:03 +08:00
lagagain d8921d5256
Rename Windows Metrics(swap -> virtual memory) (#12107)
* Fix/Change Windows metrics name(Swap -> Virtual Memory)
  - `memory_swap_free` -> `memory_virtual_memory_free`
  - `memory_swap_total` -> `memory_virtual_memory_total`
  - `memory_swap_percentage` -> `memory_virtual_memory_percentage`
* Fix/Change UI init setting for Windows Swap -> Virtual Memory
* Fix `Memory Swap Usage`/`Virtual Memory Usage` display with UI init.(Linux/Windows)
2024-04-16 08:39:53 +08:00
Wan Kai a8b0d18943
Remove group and support labels in the meter histogram-percentile function. (#12101) 2024-04-15 15:22:36 +08:00
tison ee01ce878b
chore: update comment of MySQLTableInstaller (#12099)
No longer extend from H2TableInstaller.
2024-04-14 19:28:18 +08:00
weixiang1862 7a6a19db7f
Aggregate nginx service metrics by using `multiple labels` feature & Remove unused type label in latency metrics. (#12096) 2024-04-12 18:08:07 +08:00
吴晟 Wu Sheng 7701e425d6
Remove `kafka-fetcher/default/createTopicIfNotExist` (#12095) 2024-04-12 10:35:24 +08:00
Wan Kai 13bb3f62a6
Fix not throw error when part of expression not matched any expression node in the `MQE` and `PromQL. (#12093) 2024-04-11 22:50:55 +08:00
吴晟 Wu Sheng f97fd4f6e4
Remove unnecessary `componentIds` as series ID (#12091)
* Remove unnecessary `componentIds` as series ID in the `ServiceRelationClientSideMetrics` and `ServiceRelationServerSideMetrics` entities.
2024-04-11 13:14:06 +08:00
Wan Kai 5a90121c82
Sync UI (#12089) 2024-04-11 10:19:59 +08:00
kezhenxu94 f5cd798185
Fix `NullPointerException` in Istio ServiceEntry registry (#12087) 2024-04-10 20:43:01 +08:00
Wan Kai bbbed44863
[Break Change]: Labeled Metrics support multiple labels. (#12082) 2024-04-10 19:57:36 +08:00
mrproliu 8dd842189d
Fix missing dashboard settings (#12078) 2024-04-08 17:33:20 +08:00
Gao Hongtao eeef140032
Fix several issues of the data generator and BanyanDB plugin (#12047) 2024-03-22 09:10:17 +08:00
Wan Kai b6d8d3a174
Fix `AvgHistogramPercentileFunction` legacy name. (#12039) 2024-03-19 09:42:14 +08:00
Gao Hongtao f4836327a6
Remove redanduent source in mock mode (#12033) 2024-03-18 14:11:20 +08:00
Gao Hongtao 3f4126a28a
Refactor data-generator to support generating metrics (#12031) 2024-03-17 23:07:03 +08:00
SheltonZSL 935ab0b17d
Display the port services listen to from OAP and UI (#12030) 2024-03-17 21:58:40 +08:00
Starry 8a4585ceec
Add Golang as a supported language for Kafka (#12027) 2024-03-16 22:24:08 +08:00
mrproliu 8fad0cc8a8
Adding more access log metrics into k8s dashboards (#12018) 2024-03-14 21:52:21 +08:00
Starry c5e0f5f5a6
Add hierarchy for Pulsar (#11971) 2024-03-08 09:34:03 +08:00
Chen Ziyan 00ccaceb27
Support ClickHouse server monitoring & Support service hierarchy (#11966) 2024-03-07 09:41:39 +08:00
peachisai 5fe4f491dc
Add Kafka hierarchy (#11954) 2024-03-04 14:13:27 +08:00
Wan Kai 80bf5d360c
Remove Column#function mechanism in the kernel and make query `readMetricValue` always return the average value of the duration. (#11976) 2024-03-04 09:56:59 +08:00
peachisai eb071e49df
Add hierarchy for RabbitMQ (#11935)
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-27 12:18:36 +08:00
Starry f006edd158
Add Golang as a supported language for Pulsar (#11937) 2024-02-27 09:00:32 +08:00
Wan Kai 30748d2052
Fix Service Layer when building Events in the EventHookCallback. (#11918) 2024-02-23 14:01:55 +08:00
ooi22 8737725624
Modifying the limit size of DCS gRPC inbound message (#11892) 2024-02-23 08:54:45 +08:00
Chen Ziyan 0f7844278a
Fix day-based table rolling time range strategy in JDBC storage. (#11915) 2024-02-22 23:15:38 +08:00
Wan Kai a41bd6eddd
Mock `/api/v1/status/buildinfo` for PromQL API (#11901) 2024-02-20 19:21:22 +08:00
Chen Ziyan a61b3bb1f7
Fix table exists check in the JDBC Storage Plugin. (#11897) 2024-02-20 15:01:11 +08:00
weixiang1862 a471b85ac2
Fix ServiceInstance `in` query. (#11888) 2024-02-19 16:20:45 +08:00
peachisai 48c766ee01
Support RocketMQ monitoring (#11758)
* Support RocketMQ monitoring
* Add swip3 - RocketMQ monitoring
* Add RocketMQ e2e cases

---------

Co-authored-by: peachisai <497533062@qq.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-18 07:17:20 +08:00
Starry b775e7f547
Add Golang as a supported language for RocketMQ (#11877) 2024-02-13 17:04:15 +11:00
peachisai a688500fb4
Add `count` aggregation function for MAL (#11869)
Co-authored-by: Wan Kai <wankai123@foxmail.com>
2024-02-06 10:48:51 +08:00
Wan Kai 78d9e33f10
Add hierarchy relations auto-matching for NGINX/APISIX. (#11870)
Fix `Nginx-Instance` metrics to instance level.
2024-02-05 18:59:31 +08:00
Wan Kai 9dc4fd3b01
Support available layers of service in the topology. (#11844) 2024-01-30 12:51:15 +08:00
Starry 5b5fb3984f
Add Golang as a supported language for AMQP. (#11838) 2024-01-28 22:52:54 +08:00
Wan Kai 2f4f4a1275
Add hierarchy relations auto-matching for MYSQL/POSTGRESQL/SO11Y_OAP/VIRTUAL_DATABASE. Fix MQE in dashboards when using `Card widget`. (#11818) 2024-01-24 15:03:45 +08:00
Wan Kai cc79bf688c
Add dashboards for Service/Instance Hierarchy. (#11797)
* Add dashboards for Service/Instance Hierarchy.
Fix dashboard `K8S-Service-Root` metrics expression.
2024-01-18 18:31:19 +08:00
weixiang1862 f4a8f4aa99
Fix wrong timeBucket in topN group key. (#11792) 2024-01-17 17:50:41 +08:00
weixiang1862 b43ab447f7
Change topN group key from `StorageId` to `entityId + timeBucket`. (#11788)
In `LimitedSizeBufferedData`, it uses `HashMap<StorageId, LinkedList<STORAGE_DATA>>` to stash records. 
With data storage as topN group key, topN records have no chance to compare with each other, so every record will be stashed into the map and finally persistent into DB. In addition, continuous record stash in a topN period will bring pressure to oap memory.

TopN group key is changed to `entityId + timeBucket`, then stash map can only reserve topN of every entity(db, cache) in the minute level.
2024-01-17 16:00:47 +08:00
peachisai af4f469078
Add `max` and `min` functions for mal down sampling (#11778) 2024-01-16 11:33:09 +08:00
Wan Kai 75243eebdd
Filter conjecturable relations from service hierarchy query. (#11782)
* Remove conjecturable relations from service hierarchy query.
* sync ui
2024-01-16 10:59:42 +08:00
吴晟 Wu Sheng 811b9c1000
Remove unnecessary annotations and functions from Meter Functions. (#11781) 2024-01-16 10:25:27 +08:00
peachisai 52c29354f2
Fix SumPerMinFunctionTest error function (#11773)
Co-authored-by: 邵一鸣 <shaoym02@vanke.com>
2024-01-15 15:56:50 +08:00
mrproliu e481324e93
Support handle eBPF Access Logs and update related UI (#11732) 2024-01-15 11:00:08 +08:00
Chen Ziyan e004762dfe
Fix NPE in log query by traceId. (#11764) 2024-01-12 20:13:23 +08:00
Wan Kai da0205bc58
Add layer level query and more fields for Hierarchy, and docs. (#11756) 2024-01-12 16:17:15 +08:00
kezhenxu94 e6f1e3b4c6
Allow using a dedicated port for ALS receiver (#11749) 2024-01-11 15:05:47 +08:00
Wan Kai 593bd056f6
Support Service Hierarchy auto matching. (#11743) 2024-01-10 08:59:04 +08:00
mrproliu e50a46b723
Change the string field in Elasticsearch storage from **keyword** type to *text* if they appoint size more than `32766` (#11731) 2024-01-07 18:13:54 +08:00
Wan Kai ce5d6a4ffb
Support build Service/Instance Hierarchy and query. (#11698) 2023-12-27 10:02:31 +08:00
吴晟 Wu Sheng eb4cebf9ab
Set up the length of source and dest IDs in relation entities of service, instance, endpoint, and process to 250(was 200). (#11686) 2023-12-22 09:12:50 +08:00
kezhenxu94 8ff67d09e9
Allow excluding ServiceEntries in some namespaces when looking up ServiceEntries (#11640) 2023-12-08 06:02:17 -08:00
kezhenxu94 39c21e3b45
Remove unreasonable default configurations for gRPC thread executor (#11639) 2023-12-07 21:59:45 -08:00
Jim f6a7791053
Fix "Network Bandwidth Usage" unit/value mismatching in Linux-Service Dashboard (#11637) 2023-12-07 08:55:30 -08:00
mrproliu fcf1770e07
Add `is_present` function in MQE for check the present status of the list of metrics. (#11627)
The present status is true meaning the metric exists and include values not empty.
2023-12-05 00:14:42 -08:00
mrproliu e9df2bd41e
Add `layer` parameter to the global topology graphQL query. (#11620) 2023-12-01 10:39:45 -08:00
吴晟 Wu Sheng 497a7bdb02
Release 9.7 and start 10.0 iteration (#11607) 2023-11-28 23:49:44 -08:00
Wan Kai 075b08ce74
Support `increase/rate` function in the `MQE` query language. (#11591) 2023-11-27 15:40:13 -08:00
吴晟 Wu Sheng 58dd3b8922
Remove OpenFunction(FAAS layer) relative UI templates and menu item. (#11570) 2023-11-27 07:30:18 -08:00
kezhenxu94 173c290c19
Group service endpoints into `_abandoned` when endpoints have high ca… (#11588) 2023-11-26 22:15:02 -08:00
mrproliu d59f548331
Replace Metrics v2 protocol with MQE in UI Topology related templates (#11592) 2023-11-27 10:36:57 +08:00
kezhenxu94 5e97709c30
Fix hardcoded module version (#11582)
Follow up https://github.com/apache/skywalking/pull/11579
2023-11-23 12:45:31 +08:00
吴晟 Wu Sheng dd09d08c0c
Support `Scratch The OAP Config Dump`. (#11579) 2023-11-23 00:22:41 +08:00
pg.yang 2d8df37ce6
Fix incorrect apisix metrics otel rules (#11576) 2023-11-22 13:28:59 +08:00
mrproliu df6504863f
Replace Metrics v2 protocol with MQE in UI templates and E2E Test (#11575) 2023-11-22 09:44:37 +08:00
Wan Kai 600ea37a4d
Fix `BanyanDB Metadata Query`: make query single instance/process return full tags to avoid NPE. (#11567) 2023-11-20 14:01:53 +08:00
weixiang1862 8bff0aa38d
Support Nginx monitoring. (#11558) 2023-11-17 14:16:10 +08:00
吴晟 Wu Sheng 257684a0b8
Change the policy of the queue(DataCarrier) L1 in the metric aggregate worker to IF_POSSIBLE mode (#11554) 2023-11-16 19:50:24 +08:00
weixiang1862 eaac1c3ec4
Fix JDBC Log query order. (#11544) 2023-11-15 10:20:20 +08:00
Fine0830 9fee0922a8
Sync UI: Implement the Dark Theme (#11543) 2023-11-14 22:02:54 +08:00
weixiang1862 019c6feb2e
Isolate MAL CounterWindow cache by metric name. (#11526) 2023-11-11 00:09:37 +08:00
kezhenxu94 b514fbcf38
Fix `limit` doesn't work for `findEndpoint` API in ES storage (#11523) 2023-11-09 16:25:54 +08:00
吴晟 Wu Sheng 3c8ac675b5
Update Groovy 3 to 4.0.15. (#11517) 2023-11-09 11:31:31 +08:00
mrproliu 7b01a4ab91
Fix cannot query zipkin traces with `annotationQuery` parameter in the JDBC related storage (#11511) 2023-11-08 15:06:49 +08:00
吴晟 Wu Sheng f8c6855814
Support output key parameters in the booting logs. (#11506) 2023-11-06 23:57:58 +08:00
peachisai a34a0b71af
Fix incorrect notes of slowCacheReadThreshold. (#11499) 2023-11-04 22:01:11 +08:00
weixiang1862 0f8c67822d
Support extract timestamp from patterned datetime string in LAL. (#11489) 2023-11-03 14:42:04 +08:00
Xiangying Meng ced3f22708
Feature pulsar monitoring (#11339) 2023-10-31 21:04:16 +08:00
yswdqz 92af797296
[Feature] GraalVM Native Image support (Experimental). (#11365) 2023-10-30 21:23:53 +08:00
Wan Kai 4c7dbbc57d
BanyanDBStorageClient: Add `define(Property property, PropertyStore.Strategy strategy)` API. (#11461) 2023-10-27 13:39:53 +08:00
Starry 1706020f30
Add a component ID for Fiber (ID=5021) (#11450) 2023-10-24 08:36:47 +08:00
peachisai fac8309e13
Add a component ID for Netty (#11442) 2023-10-21 20:39:26 +08:00
Wayne Chu 5d0bd0569b
Support collect ZGC memory pool metrics (#11432)
* Support collect ZGC memory pool metrics

* submodule update
2023-10-20 15:38:33 +08:00
Wan Kai 062b31f4ba
Fix AlarmRule expression validation: add labeled metrics mock data for check. (#11437) 2023-10-20 10:45:15 +08:00
吴晟 Wu Sheng 39eae22b94
Fix imports (#11436) 2023-10-20 09:49:57 +08:00
Wan Kai 1a27da5727
Fix `WebhookCallback` send incorrect messages, add catch exception for each callback HTTP Post. (#11424) 2023-10-19 07:24:42 +08:00
dogblues ce707a4d52
Specific only necessary fields when queryBasicTraces in ElasticSearch (#11419) 2023-10-18 01:21:58 -05:00
xuyue97 d9e94844e5
add component ID for fasthttp-go agent (#11418) 2023-10-18 12:38:16 +08:00
kezhenxu94 920d6531cf
Bump up netty again to 4.1.100 (#11414)
* Bump up netty again to 4.1.100
2023-10-17 10:54:53 -05:00
Wan Kai 3270d18fe8
Fix `EventHookCallback` build event: build the layer from `Service's Layer` (#11413) 2023-10-16 19:02:50 +08:00
kezhenxu94 0bbdd376b2
test: fix ES disk insufficient in test (#11406) 2023-10-13 06:42:48 -05:00
weixiang1862 90f723ef03
Adjust `AlarmRecord` alarmMessage column length to 512. (#11404) 2023-10-12 16:16:42 +08:00
mrproliu 4621e5191f
Enhance extensibility of HTTP Server library (#11401) 2023-10-12 02:12:53 -05:00
Liu Haoyang 34e3b64f94
Fix table exists check in the jdbc storage plugin (#11392) 2023-10-10 17:26:34 +08:00
Wan Kai 4fa156aed5
BanyanDBStorageClient: Add `keepAliveProperty` API. (#11383) 2023-10-08 18:08:38 +08:00
Jiajing LU 338ebcaaa1
Update BanyanDB Java Client to 0.5.0 (#11370) 2023-10-04 09:24:41 -05:00
block666 d6187a1bf8
Remove dashboard json header (#11364) 2023-10-03 20:28:20 -05:00
yswdqz a1822201ad
[Feature] Substitute classes to prepare for Graal native-image[stage 1]. (#11354) 2023-09-27 11:03:11 +08:00
Wan Kai 2b7e5ee625
Fix Zipkin trace receiver response: make the HTTP status code from `200` to `202`. (#11356) 2023-09-25 16:52:59 +08:00
block666 7ff7d73642
Apply MQE on K8s layer UI-templates (#11350) 2023-09-24 12:37:14 +08:00
dylanforest e448febb4f
Add a release mechanism for alarm windows when it is expired in case of OOM. (#11336) 2023-09-16 07:13:40 +08:00
Wan Kai 1943ce0c25
Fix elasticsearch merge management (#11334) 2023-09-15 16:19:34 +08:00
Wan Kai bb830ee6d3
Elasticsearch storage merge all management data indices into one index `management` (#11328) 2023-09-14 17:20:32 +08:00
Zhu Wang 1c273d6f80
[Feature] Add kafka monitoring (#11282) 2023-09-13 21:12:34 +08:00
ZhengBing520 921d0073ce
Fix Custom alarm rules are overwritten by 'resource/alarm-settings.yml'(#11311) (#11313) 2023-09-09 11:23:37 +08:00
Wan Kai 8e529ee956
ElasticSearchClient: Add `deleteById` API. (#11305) 2023-09-05 17:20:43 +08:00
吴晟 Wu Sheng a336b3cff4
Release 9.6.0 and begin 9.7.0 iteration (#11289) 2023-09-01 22:57:18 +08:00
mrproliu 31e0ecacdb
Add OTLP Tracing support as a Zipkin trace input (#11287) 2023-09-01 17:12:58 +08:00
Klein 7c0d3fdddc
Add Iris component ID(5018). (#11284) 2023-08-31 22:12:32 +08:00
kezhenxu94 572c195928
Do not start server and Kafka consumer in init mode (#11278) 2023-08-29 22:24:09 +08:00
Wan Kai 8dad5181e3
Alarm rule add scope verify and UT (#11272) 2023-08-29 11:14:54 +08:00
Wan Kai 23e7b88f2e
optimize and throws IllegalExpressionException in AlarmRule expression verify. (#11270) 2023-08-28 12:04:07 +08:00
Pyq f4d85e8eb0
Fix listInstances not using endTime query (#11269) 2023-08-27 23:50:14 +08:00
kezhenxu94 16f940b5ce
Check results in ALS as per downstream/upstream instead of per log (#11265) 2023-08-27 12:20:35 +08:00
Wan Kai 8763359fc1
[Breaking change] Support MQE in the Alerting. (#11262) 2023-08-25 11:39:48 +08:00
mrproliu f06886c1ef
Enhance the `serviceRelation` in MAL by adding settings for the `delimiter` and `component` fields (#11251) 2023-08-22 18:19:42 +08:00
kezhenxu94 1d5be387e0
Fix the Kubernetes resource cache not refreshed (#11242) 2023-08-21 12:19:39 +08:00
Wan Kai 5491c04a8a
Support `Compare Operation` in MQE (#11226) 2023-08-16 16:44:23 +08:00
block666 034a68b100
Apply MQE on Browser layer UI-templates (#11220) 2023-08-16 10:16:08 +08:00
peachisai 5db8d32af1
Add Nacos component ID (#11219) 2023-08-16 03:15:15 +08:00
Wan Kai 2b5d2b5f00
Fix MQE Binary Operation between labeled metrics and other type of value result. (#11217) 2023-08-15 12:57:36 +08:00
kezhenxu94 068d5d0721
Apply expressions in service mesh dashboards (#11161) 2023-08-15 11:17:26 +08:00
mrproliu 6cca6c18d7
Improve PromQL to allow for multiple metric operations within a single query (#11210) 2023-08-11 17:58:18 +08:00
kezhenxu94 49bf7a171a
Make builds reproducible for automatic releases CI (#11204) 2023-08-11 10:38:12 +08:00
block666 7f63bfe0a4
Apply MQE on Infra-Windows layer UI-templates (#11203) 2023-08-10 11:07:00 +08:00
kezhenxu94 f63764cd33
Fix the wrong default value of `k8sServiceNameRule` if it's not explicitly set (#11200) 2023-08-09 15:01:46 +08:00
block666 d30361d6bd
Apply MQE on Virtual_MQ and Infra Linux layer UI-templates (#11127) 2023-08-09 13:00:43 +08:00
mrproliu 12744bba02
Add `view_as_seq` function in MQE for listing metrics in the given prioritized sequence (#11194) 2023-08-09 11:59:49 +08:00
weixiang1862 64b24f7ddb
Use listening mode for Apollo configuration. (#11186) 2023-08-08 20:17:18 +08:00
Harry 241d17eb56
Apply MQE on RabbitMQ Dashboards (#11184) 2023-08-08 16:18:11 +08:00
吴晟 Wu Sheng abc7aa88f1
Polish ElasticSearch relative docs and bump up tested versions. (#11179) 2023-08-05 22:56:22 +08:00
Wan Kai a4c7705ddf
Move MQE codes to independent Maven module in`oap-server`. (#11176) 2023-08-05 11:46:17 +08:00
mrproliu 8de4d87422
Add Mux Server component ID(5017) language: Golang. (#11175) 2023-08-04 13:41:42 +08:00
weixiang1862 0949db406d
Support LogQL HTTP query APIs. (#11168) 2023-08-03 22:05:31 +08:00
Wan Kai 9a8d90dc0d
Remove the unreasonable rule in alarm-settings (#11166) 2023-08-01 17:42:11 +08:00
吴晟 Wu Sheng 60370c8ef9
Fix BooleanMatch and BooleanNotEqualMatch doing Boolean comparison. (#11157) 2023-07-31 12:49:25 +08:00
pg.yang 33ea0f1347
Apply MQE on APISIX, AWS_EKS, AWS_GATEWAY and AWS_S3 layer UI templates (#11148) 2023-07-30 14:33:09 +08:00
Wan Kai 9c2376a960
Support multiple configs for each hook types and specifying the hooks in the alarm rule. (#11137)
* [Breaking change] Adjust the structure of hooks in the `alarm-settings.yml`. Support multiple configs for each hook types and specifying the hooks in the alarm rule.
2023-07-27 09:12:47 -07:00
weixiang1862 8a82ac885d
Support MongoDB monitoring (#11111)
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: Harry <innerpeace.zhai@gmail.com>
2023-07-20 20:18:56 -07:00
mrproliu a3054533df
Update Golang instance metrics UI template for adapt Go Agent metrics reporter (#11121) 2023-07-20 11:38:13 -07:00
mrproliu 2a08cd86c5
Add component ID for lock frameworks (#11122) 2023-07-20 08:45:00 -07:00
kezhenxu94 1de70adb6c
Do not print sensitive properties' values in logs (#11120) 2023-07-20 07:38:05 -07:00
Wan Kai 58352ce6dc
Fix Elasticsearch storage TTL timer, move creation of the latest index before retrieval indexes by aliases to avoid the 404 exception. (#11119) 2023-07-20 21:37:10 +08:00
weixiang1862 283a860165
Fix `index out of bounds exception` in `aggregate_labels` MQE function(#11045) (#11112) 2023-07-19 13:47:02 +08:00
ethan256 88fb1faceb
Add component ID(5015) for echo, language: Golang. (#11102) 2023-07-17 02:29:27 -07:00
mrproliu 8b2fe88415
Using cache reference for query UI menu (#11099) 2023-07-17 09:07:38 +08:00
pg.yang 97e4c3a591
Apply MQE on VIRTUAL_CACHE layer UI-templates (#11098) 2023-07-16 20:09:18 +08:00
yswdqz 81dd396db6
Apply MQE on MYSQL, POSTGRESQL, REDIS, ELASTICSEARCH and DYNAMODB layer UI templates. (#11093) 2023-07-16 10:39:31 +08:00
kezhenxu94 e6e82547c8
Revert part of #10616 to fix the unexpected changes (#11089) 2023-07-14 19:19:39 +08:00
mrproliu b060dc161c
Cache all service entity in memory for query (#11086) 2023-07-14 17:12:20 +08:00
mrproliu 127c7044c6
Add i18n key for the UI menu query (#11079) 2023-07-12 14:35:38 +08:00
mrproliu 306000761c
Add description and document link into the UI menu query protocol (#11070) 2023-07-11 10:18:15 +08:00
kezhenxu94 a382112b23
Allow skipping UI menu configuration (#11068) 2023-07-10 21:59:48 +08:00
Wan Kai 1630f1afa7
[Breaking change] Change the default label name in MQE from `labe`l to `_`. (#11051) 2023-07-06 13:03:04 +08:00
weixiang1862 a8cf4fb4b6
Support reduce aggregate function in MQE.(#11031) (#11036) 2023-07-05 14:24:02 +02:00
Jiajing LU 8aab7d7ac7
Bump up BanyanDB and Java Client to 0.4.0 (#11039) 2023-07-04 18:41:23 +02:00
吴晟 Wu Sheng ab8b1f7843
Tolerate parameter value in illegal JSON format. (#11032) 2023-07-01 18:53:58 +02:00
吴晟 Wu Sheng fb19ec41ac
Set the `SW_QUERY_MAX_QUERY_COMPLEXITY` default value to 3000 (#11025) 2023-06-29 11:58:48 -04:00
weixiang1862 137fb64888
Fix instance query in JDBC implementation.(#11023) (#11024)
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
2023-06-29 18:58:00 +08:00
kezhenxu94 a3adc3d74e
Fix environment variable name (#11020) 2023-06-29 16:49:55 +08:00
mrproliu 6131e4c6a3
Support dynamic UI menu query (#11005) 2023-06-29 14:09:32 +08:00
weixiang1862 dfba1c634a
Fix metric session cache saving after batch insert when using mysql-connector-java.(#11009) (#11012) 2023-06-28 17:58:59 +08:00
Wan Kai 4b2d1ee5a4
Fix display name of `endpoint_cpm` for endpoint list in `General-Service` dashboard. (#11004) 2023-06-28 11:44:56 +08:00
Superskyyy 37b4896d47
Fix and optimize AI endpoint grouping related functionalities (#11003) 2023-06-28 06:02:38 +08:00
Gao Hongtao 5ad74eb261
BanyanDBMetricsDAO: handle storeIDTag in multiGet for BanyanDBModelExtension (#11002) 2023-06-27 15:40:20 +08:00
Brandon Fergerson c5c268b653
refactor: rename recevier to receiver (#11001) 2023-06-27 08:51:35 +08:00
dd1k e4f46db647
Add component ID(149) for Aerospike java client plugin (#11000) 2023-06-26 23:43:02 +08:00
kezhenxu94 d13d44828a
Fix ElasticSearch scroller bug (#10999) 2023-06-26 19:55:21 +08:00
吴晟 Wu Sheng 77da556c9e
Control the period of training and sync HTTP URI recognition patterns (#10997) 2023-06-26 19:02:56 +08:00
kezhenxu94 8997796a04
Revert selecting `Ready` Pods, remove `Terminating` Pods in OAP cluster (#10988) 2023-06-25 13:50:58 +08:00
kezhenxu94 cb165eb2ca
Scroll all results of Endpoint in ElasticSearch storage and refactor scrolling logics to reduce boilerplate codes (#10986) 2023-06-24 23:01:56 +08:00
Wan Kai 4d191993aa
Fix `NPE` in metrics query when the metric is not exist. (#10980)
* Fix `NPE` in metrics query when the metric is not exist.

* Fix metric name `browser_app_error_rate` in `Browser-Root` dashboard.

* Exclude istio 1.7 from testing again.

---------

Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2023-06-23 14:41:31 +08:00
kezhenxu94 cf696ab698
Only list healthy Pods when forming OAP cluster (#10969) 2023-06-21 14:02:26 +08:00
Superskyyy d036224d72
Fix NPE and IllegalArgument in AI-based formatting (#10973) 2023-06-21 13:01:15 +08:00
weixiang1862 3b4f642b83
Add component ID for WebSphere.(#10887) (#10974)
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
2023-06-21 10:23:47 +08:00
吴晟 Wu Sheng 56cfa52d87
Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData` (#10966)
* [Breaking change] Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData`.

* * Remove patterns from `HttpUriRecognitionService#feedRawData` and add max 10 candidates of raw URIs for each pattern.

---------

Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2023-06-20 13:17:05 -04:00
Wan Kai ba771097f1
Wrap `deleteProperty` API to the BanyanDBStorageClient. (#10971) 2023-06-20 23:12:26 +08:00
kezhenxu94 cb2676845b
Improve Kubernetes coordinator to only select ready OAP Pods to build cluster (#10950) 2023-06-16 21:45:19 +08:00
kezhenxu94 a23f905ce0
Add Istio ServiceEntry registry to resolve unknown IPs in ALS (#10936) 2023-06-15 20:11:19 +08:00
Jedore 294f419b0d
Add Neo4j component language: Python (#10937) 2023-06-14 21:17:42 +08:00
吴晟 Wu Sheng 1f6ea1d744
Begin 9.6.0 iteration (#10935)
* [maven-release-plugin] prepare release v9.5.0

* [maven-release-plugin] prepare for next development iteration

* Create changes-9.5.0.md

* Set changes.md for 9.6.0
2023-06-14 18:26:50 +08:00
mrproliu 1e1457b9bd
Add Continuous Profiling tab on `Mesh` layer UI-templates (#10927) 2023-06-14 11:55:09 +08:00
吴晟 Wu Sheng 848583cde5
Improve match performance of URI matching in 40% (#10923)
## Conclusion
1. In matching the first rule scenario, the new implementation(mostly due to split performance), it is 40% fast than the previous implementation.
2. Quick match has a huge advantage in GC(time and cost) and memory cost(alloc, G1 Eden and G1 Old) in every case. In my 64G M1 Max env, the regex matching even causes full GC just in the benchmark, which is only running in 2:11 mins. The regex would be a disaster for product env memory.
3. The quick match only has lower performance when the number of pattern rules is less than 4, which is nearly impossible. Even for that, Regex matching costs most GC and memory alloc in a one-time match, and 3-time cost in 4 times match.

## Other Changes
1. I made the URI cache only works in AI pipeline works, as it should. This was a bug in the previous commit.
2. `/` is not required in this case, as generally, the pattern recognition should work well for the demo name as well.
2023-06-13 20:15:40 +08:00
Wan Kai feb3ca2b6d
Add UT and E2E for MQE. (#10920) 2023-06-13 17:58:15 +08:00
mrproliu 43668b7655
Add cause message field when query continuous profiling task (#10919) 2023-06-13 11:51:56 +08:00
Marc Navarro 5dd91181a1
Consider 4xx as client side error for envoy ALS based metrics (#10905) 2023-06-13 10:41:21 +08:00
kezhenxu94 1726040a04
Migrate from kubernetes-client/java to fabric8 client (#10917) 2023-06-13 10:00:23 +08:00
weixiang1862 4c79707369
Support `sumLabeled` in `MAL` (#10885) (#10916)
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
2023-06-12 12:37:14 -05:00
Wan Kai 154a35fa47
Apply MQE on General and Virtual-Database layer UI-templates. (#10913) 2023-06-12 11:06:34 +08:00
吴晟 Wu Sheng a5b244817f
Add `ai-pipeline` module and support HTTP URI formatting (#10884)
* Support HTTP URI formatting through ai-pipeline to do pattern recognition.
* Add new HTTP URI grouping engine with benchmark.
* [Breaking Change] Use the new HTTP URI grouping engine to replace the old regex based mechanism.
2023-06-10 12:22:00 +08:00
Wan Kai 260a7106dd
MQE: remove query `returnTypeOfMQE`, add new aggregation operator `latest` (#10906) 2023-06-09 11:32:16 +08:00
mrproliu de3e3d27ec
Update continuous profiling E2E for adapt new query protocol (#10901) 2023-06-09 09:44:07 +08:00
Jiekun c0ddbdf178
Add go-redis to component-libraries.yml (#10883) 2023-06-08 23:26:44 +08:00
Wan Kai 426d015086
MQE support binary operation between labeled metrics (#10888) 2023-06-07 13:48:54 +08:00
Wan Kai 0f847438c7
Support Metrics Query Expression(MQE) and allows users to do simple query-stage calculation through the expression. (#10881) 2023-06-05 17:22:05 +08:00
lu-xiaoshuang ecda943fba
fix wrong widget name of general-service (#10880) 2023-06-05 12:06:16 +08:00
mrproliu a7bb50e63e
Adapt the continuous profiling task query GraphQL (#10878) 2023-06-02 22:14:40 +08:00
innerpeacez 0c572b2252
add rabbitmq doc chart (#10853) 2023-05-25 05:49:05 -04:00
yswdqz 81ec3af923
[Feature] Redis slow log collection (#10825) 2023-05-22 20:31:00 +04:00
kezhenxu94 fc2eced32c
Add OpenTelemetry log protocol support (#10808) 2023-05-18 11:46:42 +08:00
innerpeacez 1230bf4d4b
Support RabbitMQ monitoring (#10814) 2023-05-17 11:56:44 +08:00
innerpeacez f8567f7907
Filter out unknown_cluster metric data in `elasticsearch-monitoring` (#10801)
* filter unknown_cluster

* add changes
2023-05-15 11:32:05 +08:00
liuzc9 4713073326
Fix typo in NacosCoordinatorTest (#10795) 2023-05-12 17:53:21 +08:00
Wan Kai 505d55a1c8
Fix potential NPE in Zipkin receiver when the Span is missing some fields. (#10791) 2023-05-11 21:29:42 +08:00
xu1009 54ae820fb2
add Grizzy component id (#10788)
Co-authored-by: litexu <litexu@tencent.com>
2023-05-10 23:58:31 +08:00
好久不见 ea0c1b9354
Support to export error status trace segments (#10760) 2023-05-05 14:59:29 +08:00
gzlicanyi 5bf05cc3e9
Feature/searchable tags watcher (#10758) 2023-05-04 21:07:44 +08:00
kezhenxu94 d874c211f6
Clean up OpenCensus related codes and docs (#10755) 2023-05-04 11:13:17 +08:00
xu1009 8276328436
Add component ID for Jersey (#10745) 2023-04-28 17:30:03 +08:00
Jiajing LU 06558fcf5a
Integrate BanyanDB server-side TopN (#10448) 2023-04-25 10:37:55 +08:00
Wan Kai 1ca9e0acfe
Fix PromQL HTTP API `/api/v1/series` response missing `service` label when matching metric (#10715) 2023-04-23 10:31:52 +08:00
吴晟 Wu Sheng af2cf9958f
Polish log of alert GRPCCallback (#10712) 2023-04-22 21:24:20 +08:00
innerpeacez cce87a9917
Support Elasticsearch monitoring (#10690) 2023-04-20 17:53:01 +08:00
Wan Kai 7c1e3d98a1
UI templates: Simplify metric name with the label. (#10704) 2023-04-19 19:58:57 +08:00
pg.yang 8c6bc1b4c5
Support no-proxy mode for aws-firehose receiver (#10684)
* upgrade armeria to 1.23.1

* Support no-proxy mode for aws-firehose receiver
2023-04-15 18:54:47 +08:00
jmjoy 20b10abe2e
Add component ID for amqp, amqp-producer and amqp-consumer. (#10693)
* Add amqp component.

* Update changelogs.
2023-04-15 00:30:16 +08:00
Wan Kai 95c398115b
Set `showSymbol: true`, and make the data point shows on the Line graph. (#10687) 2023-04-14 13:21:49 +08:00
yswdqz 2cbeb55359
Support Redis Mornitoring (#10655) 2023-04-08 19:03:31 +08:00