d036224d72
Fix NPE and IllegalArgument in AI-based formatting ( #10973 )
2023-06-21 13:01:15 +08:00
3b4f642b83
Add component ID for WebSphere.( #10887 ) ( #10974 )
...
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
2023-06-21 10:23:47 +08:00
56cfa52d87
Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData` ( #10966 )
...
* [Breaking change] Remove `matchedCounter` from `HttpUriRecognitionService#feedRawData`.
* * Remove patterns from `HttpUriRecognitionService#feedRawData` and add max 10 candidates of raw URIs for each pattern.
---------
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
2023-06-20 13:17:05 -04:00
ba771097f1
Wrap `deleteProperty` API to the BanyanDBStorageClient. ( #10971 )
2023-06-20 23:12:26 +08:00
cb2676845b
Improve Kubernetes coordinator to only select ready OAP Pods to build cluster ( #10950 )
2023-06-16 21:45:19 +08:00
a23f905ce0
Add Istio ServiceEntry registry to resolve unknown IPs in ALS ( #10936 )
2023-06-15 20:11:19 +08:00
b5a2766cc1
Bump Guava to 32.0.1 ( #10940 )
2023-06-15 10:44:59 +08:00
294f419b0d
Add Neo4j component language: Python ( #10937 )
2023-06-14 21:17:42 +08:00
1f6ea1d744
Begin 9.6.0 iteration ( #10935 )
...
* [maven-release-plugin] prepare release v9.5.0
* [maven-release-plugin] prepare for next development iteration
* Create changes-9.5.0.md
* Set changes.md for 9.6.0
2023-06-14 18:26:50 +08:00
1e1457b9bd
Add Continuous Profiling tab on `Mesh` layer UI-templates ( #10927 )
2023-06-14 11:55:09 +08:00
1eacbe4e7a
Removed duplicate in changes.md ( #10921 )
2023-06-13 16:43:54 +08:00
43668b7655
Add cause message field when query continuous profiling task ( #10919 )
2023-06-13 11:51:56 +08:00
5dd91181a1
Consider 4xx as client side error for envoy ALS based metrics ( #10905 )
2023-06-13 10:41:21 +08:00
1726040a04
Migrate from kubernetes-client/java to fabric8 client ( #10917 )
2023-06-13 10:00:23 +08:00
4c79707369
Support `sumLabeled` in `MAL` ( #10885 ) ( #10916 )
...
Co-authored-by: weixiang1862 <weixiang1862@gmail.com>
2023-06-12 12:37:14 -05:00
154a35fa47
Apply MQE on General and Virtual-Database layer UI-templates. ( #10913 )
2023-06-12 11:06:34 +08:00
a5b244817f
Add `ai-pipeline` module and support HTTP URI formatting ( #10884 )
...
* Support HTTP URI formatting through ai-pipeline to do pattern recognition.
* Add new HTTP URI grouping engine with benchmark.
* [Breaking Change] Use the new HTTP URI grouping engine to replace the old regex based mechanism.
2023-06-10 12:22:00 +08:00
c0ddbdf178
Add go-redis to component-libraries.yml ( #10883 )
2023-06-08 23:26:44 +08:00
b635ee34da
sync ui ( #10894 )
2023-06-07 13:53:56 +08:00
e4dfbd466b
Add OpenSearch 2.8.0 to test case ( #10886 )
2023-06-07 11:09:26 +08:00
fe1cb78584
Bump up zipkin ui dependency ( #10882 )
2023-06-06 15:41:28 +08:00
0f847438c7
Support Metrics Query Expression(MQE) and allows users to do simple query-stage calculation through the expression. ( #10881 )
2023-06-05 17:22:05 +08:00
a7bb50e63e
Adapt the continuous profiling task query GraphQL ( #10878 )
2023-06-02 22:14:40 +08:00
06eb6f49b5
sync ui ( #10855 )
2023-05-25 05:27:51 +04:00
81ec3af923
[Feature] Redis slow log collection ( #10825 )
2023-05-22 20:31:00 +04:00
fc2eced32c
Add OpenTelemetry log protocol support ( #10808 )
2023-05-18 11:46:42 +08:00
1230bf4d4b
Support RabbitMQ monitoring ( #10814 )
2023-05-17 11:56:44 +08:00
f8567f7907
Filter out unknown_cluster metric data in `elasticsearch-monitoring` ( #10801 )
...
* filter unknown_cluster
* add changes
2023-05-15 11:32:05 +08:00
505d55a1c8
Fix potential NPE in Zipkin receiver when the Span is missing some fields. ( #10791 )
2023-05-11 21:29:42 +08:00
7a0331a319
Update the cluster management and advanced deployment docs ( #10790 )
2023-05-11 15:56:48 +08:00
54ae820fb2
add Grizzy component id ( #10788 )
...
Co-authored-by: litexu <litexu@tencent.com>
2023-05-10 23:58:31 +08:00
ea0c1b9354
Support to export error status trace segments ( #10760 )
2023-05-05 14:59:29 +08:00
5bf05cc3e9
Feature/searchable tags watcher ( #10758 )
2023-05-04 21:07:44 +08:00
d874c211f6
Clean up OpenCensus related codes and docs ( #10755 )
2023-05-04 11:13:17 +08:00
8453e00f14
Sync UI. ( #10751 )
2023-05-03 09:15:09 +08:00
df7486c700
* Make the log relative docs more clear, and easier for further more formats support. ( #10749 )
2023-05-02 18:23:24 +08:00
8276328436
Add component ID for Jersey ( #10745 )
2023-04-28 17:30:03 +08:00
06558fcf5a
Integrate BanyanDB server-side TopN ( #10448 )
2023-04-25 10:37:55 +08:00
1ca9e0acfe
Fix PromQL HTTP API `/api/v1/series` response missing `service` label when matching metric ( #10715 )
2023-04-23 10:31:52 +08:00
cce87a9917
Support Elasticsearch monitoring ( #10690 )
2023-04-20 17:53:01 +08:00
7c1e3d98a1
UI templates: Simplify metric name with the label. ( #10704 )
2023-04-19 19:58:57 +08:00
8c6bc1b4c5
Support no-proxy mode for aws-firehose receiver ( #10684 )
...
* upgrade armeria to 1.23.1
* Support no-proxy mode for aws-firehose receiver
2023-04-15 18:54:47 +08:00
20b10abe2e
Add component ID for amqp, amqp-producer and amqp-consumer. ( #10693 )
...
* Add amqp component.
* Update changelogs.
2023-04-15 00:30:16 +08:00
95c398115b
Set `showSymbol: true`, and make the data point shows on the Line graph. ( #10687 )
2023-04-14 13:21:49 +08:00
3dea32a098
sync ui ( #10683 )
2023-04-13 22:03:18 +08:00
2cbeb55359
Support Redis Mornitoring ( #10655 )
2023-04-08 19:03:31 +08:00
d5daf71ae0
Bump up graphql-java to fix cve and kubernetes java client to adopt snakeyaml v2 ( #10649 )
2023-04-06 11:36:49 +08:00
4ded160c94
Sync UI ( #10648 )
2023-04-06 08:05:22 +08:00
b7f456d29f
Support Amazon API Gateway monitoring ( #10645 )
2023-04-05 12:19:46 +08:00
2c26b98198
Support monitoring the total number metrics of k8s StatefulSet and DaemonSet. ( #10639 )
2023-04-05 00:41:01 +08:00
36c76b781e
docs: add SUM_PER_MIN to MAL documentation ( #10631 )
2023-04-01 00:19:54 +08:00
6d432c31f2
PromQL: Remove empty values from the query result, fix `/api/v1/metadata` param `limit` could cause out of bound. ( #10628 )
2023-03-31 16:35:06 +08:00
13c093faf9
Support collecting memory buff/cache metrics in VM monitoring. ( #10621 )
2023-03-30 20:47:54 +08:00
ec2ca354ea
Support isEmptyValue flag for metrics query. ( #10616 )
2023-03-30 14:46:07 +08:00
7168f6d7e9
Sync UI ( #10614 )
2023-03-30 11:09:52 +08:00
fffedd3914
Add Profiling related documentations ( #10612 )
2023-03-29 21:44:02 +08:00
886589c15c
Support alarm metric OP `!=` ( #10610 )
2023-03-29 17:30:31 +08:00
ec25814354
Support parse PromQL expression has empty labels in the braces for metadata query. ( #10599 )
2023-03-28 11:04:52 +08:00
7f169e9b26
Fix possible NPE when initialize `IntList`. ( #10583 )
2023-03-23 19:36:33 +08:00
d88d887a32
Fix PromQL HTTP API `/api/v1/labels` response missing `service` label. ( #10579 )
2023-03-23 16:40:05 +08:00
0de087a100
[Breaking Change] Support cross-thread trace profiling. ( #10575 )
...
The data structure and query APIs are changed.
2023-03-22 23:50:26 +08:00
e16d294bd8
Sync UI: redesign and implement new topology ( #10576 )
...
Refactor Topology widget to make it more hierarchical.
1. Choose `User` as the first node.
2. If `User` node is absent, choose the busiest node(which has the most calls of all).
3. Do a left-to-right flow process.
4. At the same level, list nodes from top to bottom in alphabetical order.
2023-03-22 17:21:56 +08:00
d6e7ee8ae3
Fix K8sRetag reads the wrong k8s service ( #10568 )
2023-03-21 16:53:58 +08:00
bb1ea0ddd7
Sync UI. ( #10566 )
...
* Revert: cpm5d function. This feature is cancelled from backend.
* Fix: alerting link breaks on the topology.
2023-03-21 09:44:21 +08:00
7dcdb279ef
Support continuous profiling feature ( #10473 )
2023-03-20 20:26:42 +08:00
3662b01365
[BUG] otel k8s-cluster rule, add namespace dimension for MAL aggregation calculation(Deployment Status,Deployment Spec Replicas) ( #10563 )
2023-03-20 16:43:01 +08:00
74a8589307
[Breaking Change] Enhance JDBC storage through merging table and managing day-based table rolling ( #10544 )
...
* [Breaking Change] Enhance JDBC storage through merging tables and managing day-based table rolling.
* [Breaking Change] Sharding-MySQL implementations and tests get removed due to we have the day-based rolling mechanism by default
2023-03-17 21:01:48 +08:00
c74d21c96f
Fix `Duplicate class found` due to the `delombok` goal. ( #10532 )
2023-03-13 17:21:21 +08:00
bfa1f7e8cf
Support to bind TLS status as a part of component for service topology. ( #10522 )
...
* Support to bind TLS status as a part of component for service topology.
* Fix component ID priority bug.
* Fix wrong priority for process relation.
* Add a UT for topology build
* Fix component ID of topology overlap due to storage layer bugs.
2023-03-10 14:31:47 +08:00
330a66e27e
ElasticSearch storage does not check field types when OAP running in `no-init` mode ( #10524 )
2023-03-10 09:58:48 +08:00
7447999b4c
Fix wrong layer of metric `userError` in DynamoDB monitoring. ( #10518 )
2023-03-09 15:09:55 +08:00
4874374ace
Tag 9.4.0 release, prepare for 9.5.0 iteration. ( #10512 )
2023-03-08 23:30:37 +08:00
1c644ba624
fix: the wrong position of the menu when clicking the topology node ( #10502 )
2023-03-08 16:39:19 +08:00
07b81992e2
Add FreeRedis component ID(3018) ( #10500 )
2023-03-08 16:20:06 +08:00
96b6690e24
Bump up snakeyaml to 2.0 ( #10495 )
2023-03-07 18:15:54 +08:00
230953b8dd
Create the UITemplate's group in the starting step ( #10442 )
...
* Create the UITemplate's group in the starting step
* Update BanyanDB client to 0.3.1.
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2023-03-07 14:01:06 +08:00
6549dc0c0e
Support for double quotes in SlowSQL statements ( #10489 )
2023-03-06 20:27:07 +08:00
90d6fccf69
sync ui ( #10456 )
...
- Add cpm5dAvg calculation.
- Add cpm5d calculation.
- Fix data processing error in the eBPF profiling widget.
2023-02-28 14:04:19 +08:00
f93a98d4c7
Adapt otel exponential histogram data ( #10449 )
2023-02-28 12:16:22 +08:00
1a2f794472
Fix `DurationUtils.getDurationPoints` exceed, when `startTimeBucket` equals `endTimeBucket`. ( #10441 )
2023-02-24 11:39:55 +08:00
d5928245d0
Add explicit `ReadTimeout` for ConsulConfigurationWatcher ( #10431 )
...
* Add explicit `ReadTimeout` for ConsulConfigurationWatcher
* Bump up skywalking-eyes
2023-02-23 10:40:11 +08:00
fb9117b8e7
Support prometheus HTTP APIs and promQL. ( #10415 )
...
Support HTTP APIs list:
- /api/v1/metadata
- /api/v1/labels
- /api/v1/label/{label_name}/values
- /api/v1/series
- /api/v1/query
-/api/v1/query_range
Support basic promQL for query traffic/metrics/labeled_metrics/topN/sampled_records from OAP
2023-02-22 12:59:45 +08:00
fbc519a4d0
Sync UI ( #10417 )
2023-02-21 09:28:50 +08:00
f6ef55b5af
Support Monitoring DynamoDB. ( #10418 )
2023-02-21 09:24:17 +08:00
af3889b47e
Bump up BanyanDB 0.3.0 client. ( #10406 )
2023-02-20 09:18:41 +08:00
155d231111
Support process Sum metrics with AGGREGATION_TEMPORALITY_DELTA case ( #10410 )
2023-02-20 07:18:36 +08:00
eda83dca93
Remove TLS support from firehose receiver ( #10409 )
...
* Remove TLS support from firehose receiver
Notice, no HTTPS/TLS setup support. By following AWS Firehose request, it uses [proxy request](https://en.wikipedia.org/wiki/Proxy_server#Web_proxy_servers ) (`https://...` instead of `/aws/firehose/metrics`), there must be a proxy(Nginx, Envoy, etc.).
* Update docs.
2023-02-19 23:25:59 +08:00
cabe40eb47
Support Amazon Simple Storage Service (AWS S3) metrics monitoring ( #10407 )
2023-02-19 17:23:10 +08:00
feaf49390c
Refactor http-based alarm plugins and extract common logic to `HttpAlarmCallback` ( #10401 )
2023-02-17 09:52:53 +08:00
b6944ae28f
Sync UI and add docs for Widget Static Link feature ( #10394 )
2023-02-16 06:53:52 +08:00
49594c4db1
Bump up Java version to 11 and use junit tag to group IT and slow IT ( #10390 )
...
- `./mvnw test ...` by its nature only runs unit tests, whose name is pattern of `*Test`, and it does never runs integration tests, whose name is patter of `IT*` or `*IT`, so in this PR we use `./mvnw clean test ...` to only run unit tests.
- `./mvnw integration-test ...` will run integration tests and unit tests, so we have `skipUTs` to control whether to skip the UT when running ITs, we already had this before.
- As for ITs, we have two groups, one is normal tests without any `@Tag`s, the other one is slow integration tests, which is annotated with `@Tag("slow")`, so we divided the integration tests into two workflow jobs:
- `./mvnw -DskipUTs=true clean integration-test -DexcludedGroups=slow ...` run the ITs but don't run the slow ITs and UTs, `-DexcludedGroups=slow` excludes tests annotated with `@Tag("slow")`
- `./mvnw -DskipUTs=true clean integration-test -Dcheckstyle.skip -Dtest=${{ matrix.test.class }}` run the slow ITs (because `excludedGroups` is not set) one case at a time, by setting `-Dtest={{ class }}`, not run UTs,
2023-02-14 23:19:32 +08:00
ff94cfc4e3
Sync UI to the latest. ( #10388 )
2023-02-14 08:31:17 +08:00
383a5bbf7b
Migrate tests from junit 4 to junit 5 ( #10382 )
2023-02-13 18:54:32 +08:00
01fe2f1486
Add HTTPX component ID(7019) ( #10383 )
2023-02-13 09:56:11 +08:00
184c6ca2c4
Refactor `@Column` annotation ( #10367 )
...
* Swap `Column#name` and `ElasticSearch.Column#columnAlias`
* Rename `ElasticSearch.Column#columnAlias` to `ElasticSearch.Column#legacyName`
2023-02-09 22:47:12 +08:00
974cecb67f
Add missing tcp throughput metrics ( #10356 )
2023-02-07 18:38:54 +08:00
967886090a
Change scapedMetricsNameCache method to support `/` ( #10349 )
2023-02-06 22:50:08 +08:00
61975da194
Sync UI ( #10350 )
2023-02-06 15:14:53 +08:00
e56308995a
[Elasticsearch] Support batchOfBytes configuration to limit size of bulk flush. ( #10287 )
2023-02-06 12:46:24 +08:00
b8e4a025aa
Avoid Antlr dependencies' versions might be different in compile time and runtime ( #10339 )
2023-02-04 15:26:49 +08:00
29556a0d00
Add aws-firehose-receiver to support collecting AWS CloudWatch metric(OpenTelemetry format) ( #10300 )
2023-01-24 14:04:27 +08:00
e360ca3628
Remove handler scan in otel receiver, manual initialization instead ( #10303 )
2023-01-23 16:10:23 +08:00
f7162d5898
Enhance OAP HTTP server to support HTTPS ( #10296 )
2023-01-20 21:17:18 +08:00
263c2b442c
Fix change log of #10282 ( #10293 )
2023-01-18 16:50:08 +08:00
b97dfb1a65
[Optional] Support trace/span on ElasticSearch to use traceIDs routing. ( #10282 )
2023-01-18 16:44:15 +08:00
12fc6884f0
Add component ID for Python websocket ( #10289 )
2023-01-18 08:15:40 +08:00
ccbfa3e554
Bump so11y docs ( #10288 )
2023-01-17 23:00:36 +08:00
c4f564c456
Sync UI ( #10285 )
...
* Add missing FastAPI logo
* Update the log details page to support the formatted display of JSON content
2023-01-17 09:50:35 +08:00
68727ee8bc
Fix gRPC alarm cannot update settings from dynamic configuration source.( #10274 ) ( #10275 )
2023-01-13 22:11:42 +08:00
3220339a1c
Update doc component-libraries.yml HBase languages ( #10272 )
2023-01-13 10:52:32 +08:00
fba96452f5
Add documentation for profiling APIs ( #10269 )
2023-01-12 14:48:21 +08:00
962493d244
Add Lens UI relative docs in Zipkin trace section. ( #10267 )
2023-01-12 09:39:47 +08:00
a5ca0e66d6
Add documentation about replacing Zipkin server with SkyWalking OAP ( #10255 )
2023-01-10 12:45:22 +08:00
4df62b6210
Fix TCP service instances are lack of instance properties like `pod` and `namespace`, which causes Pod log not to work for TCP workloads ( #10252 )
2023-01-09 21:08:21 +08:00
6a78773743
Improve BanyanDB measure schema ( #10233 )
2023-01-08 18:50:00 +08:00
2b40270f71
Add the eBPF network profiling E2E Test in per storage ( #10245 )
2023-01-06 21:53:39 +08:00
2756e0cfab
Update ShardingSphere version for compatibility verification ( #10244 )
...
* Integrate with ShardingSphere 5.3.1-SNAPSHOT.
* Update the version of ShardingSphere in e2e
* Remove providerType when the transaction type is LOCAL.
* Update backend-storage.md & changes.md
2023-01-06 17:46:23 +08:00
146aa2f079
Add Zipkin trace tab in service mesh panel ( #10239 )
2023-01-06 15:11:29 +08:00
1807574031
Bump BanyanDB Java client to 0.3.0-rc0. ( #10237 )
2023-01-06 09:49:33 +08:00
8de8c7c1e8
Support monitoring AWS Cloud EKS ( #10199 )
2022-12-31 17:34:30 +08:00
bfb90f6c88
Fix issues found by showcase cluster of the BanyanDB ( #10219 )
...
* Fix `time_bucket` of `ServiceTraffic` not set correctly in `slowSql` of MAL.
* Correct the TopN record query DAO of BanyanDB.
* Tweak interval settings of BanyanDB.
2022-12-29 22:42:39 +08:00
8ca0946a8e
Fix `time_bucket` of `ServiceTraffic` not set correctly in `slowSql` ( #10218 )
2022-12-29 22:04:56 +08:00
aff88b0d18
Support no `layer` in the `listServices` query. ( #10214 )
...
* Sync submodules. No code change.
2022-12-28 18:58:10 +08:00
f95cddcb3e
Merge `TIME_BUCKET` of `Metrics` and `Record` into `StorageData` ( #10208 )
2022-12-28 11:25:47 +08:00
9b3ef909a6
Remove time_bucket tag for BanyanDB impl ( #10202 )
2022-12-26 19:12:19 +08:00
87125aef02
Fix cannot display attached events when using Zipkin Lens UI query traces ( #10180 )
2022-12-25 14:00:43 +08:00
449b249559
Fix meter value not correct in some MAL function ( #10197 )
2022-12-23 17:54:49 +08:00
66234d52b2
Support server status watcher for `MetricsPersistentWorker` to check the metrics whether required initialization. ( #10195 )
2022-12-23 17:22:37 +08:00
222bd4acdb
Refactor Topology query for BanyanDB ( #10181 )
2022-12-23 16:36:44 +08:00
995d790b42
The cluster coordinator support watch mechanism for notifying `RemoteClientManager` and `ServerStatusService`. ( #10192 )
2022-12-22 20:52:55 +08:00
3663a4ac5f
fix ServiceMeshServiceDispatcher overwrite ServiceDispatcher debug file when open SW_OAL_ENGINE_DEBUG. ( #10187 )
2022-12-22 11:22:31 +08:00
46d3411fe9
Remove unnecessary additional columns when storage is in logical sharding mode ( #10191 )
2022-12-21 19:14:06 +08:00
6c1044c37c
Bump up netty to 4.1.86 ( #10188 )
2022-12-21 11:04:02 +08:00
bf661806af
Bump up Zipkin and Zipkin lens UI dependency to 2.24.0 ( #10185 )
2022-12-20 14:53:53 +08:00
6da1ab0d6b
fix wrong registration ( #10184 )
2022-12-19 18:07:20 +08:00
9c0ef79156
Add istio 1.16 to test matrix ( #10177 )
2022-12-17 23:55:59 +08:00
fc389fb86b
Sync ui: Migrate the build tool from vue cli to Vite4 for UI ( #10175 )
2022-12-17 21:28:23 +08:00
0b838f9a98
Make the satellite E2E test more stable. ( #10176 )
2022-12-17 21:04:52 +08:00
4ee8389b5c
Add Zipkin UI to webapp ( #10167 )
2022-12-17 14:30:51 +08:00
85be0bd568
Remove component_id from the instance topology ( #10170 )
2022-12-16 21:37:13 +08:00
9986944119
Enhance service topology to support multiple components of a service ( #10169 )
...
* Support `priority` definition in the `component-libraries.yml`.
* Enhance service topology query. When there are multiple components detected from the server side,
the component type of the node would be determined by the priority, which was random in the previous release.
2022-12-16 17:36:15 +08:00
3731f25765
Support multiple component IDs in the service topology level ( #10164 )
...
* Support multiple component IDs in the service topology level.
* Fix wrong fields used in the instance and process topology query.
2022-12-16 14:18:47 +08:00
45692303ce
Reorganize API docs. ( #10160 )
2022-12-15 15:42:38 +08:00
9a7bdc8eae
Refactor `StorageData#id` to the new StorageID object from a String type. ( #10157 )
...
* Refactor kernel id0()/id() methods to return StorageID object, rather than a built string.
2022-12-15 15:39:06 +08:00
bee8a86bda
Optimize BanyanDB interval rules ( #10128 )
...
* resolve #10104 #10102
2022-12-13 10:27:41 +08:00
fc063d018a
Another change log fix ( #10144 )
2022-12-12 09:16:49 +08:00
0afaee1d12
Fix changelog ( #10143 )
2022-12-12 08:00:30 +08:00
488737ec53
An unexpected dot is added when exp is a pure metric name and expPrefix != null ( #10142 )
...
> The final expression was (metric_name(exp).expPrefix)`.`(this is the extra dot)
The correct one should be (metric_name(exp).expPrefix)
2022-12-12 00:11:45 +08:00
3229a5c5ec
Support monitoring mariadb ( #10115 )
...
Co-authored-by: yswdqz <945407026@qq.com>
2022-12-11 21:10:23 +08:00
c5cbd3a14c
Optimize `flushInterval` of ElasticSearch BulkProcessor ( #10135 )
...
Optimize `flushInterval` of ElasticSearch BulkProcessor to avoid extra periodical flush in the continuous bulk streams.
2022-12-08 21:57:32 +08:00
3a3851f009
Change `elasticsearch/flushInterval` to 5s(was 15s). ( #10129 )
2022-12-08 10:56:36 +08:00
52598d77cb
use `core/persistentPeriod` + 5s as `refresh_interval` for all indices ( #10127 )
2022-12-08 09:44:27 +08:00
210c374976
Fix memory leak in Zipkin API ( #10126 )
2022-12-07 22:25:03 +08:00
4b7ec0bab5
Polish doc ( #10114 )
2022-12-06 21:59:33 +08:00
f1c7e93983
Fix miss set `LastUpdateTimestamp` that caused the metrics session to expire ( #10111 )
2022-12-06 18:08:30 +08:00
d6fa688ff8
Remove timeout offset and correct `MetricsExtension` declarations ( #10098 )
...
* Remove timeout offset and correct `MetricsExtension` declarations
* Fix ProcessRelation topology overlap for nodes communication with multiple component IDs.(HTTP and TCP)
* Support component IDs' priority in process relationship metrics.
* Remove abandon logic in MergableBufferedData, which caused unexpected no-update.
2022-12-06 11:12:42 +08:00
d8fce12835
Cache enhancement - don't read new metrics from database in minute ( #10085 )
2022-12-05 10:37:27 +08:00
8c31172c3c
Refactor session cache in MetricsPersistentWorker. ( #10084 )
2022-12-04 22:41:57 +08:00
532e42b2ff
Add Micrometer as a component ( #10078 )
2022-12-03 21:40:23 +08:00
f24400b56f
Add `ServerStatusService` in the core module ( #10083 )
2022-12-03 20:37:50 +08:00
18008aa6b2
Release 9.3.0. Begin 9.4.0 iteration ( #10077 )
2022-12-02 21:19:13 +08:00
a269a0016e
Update the network profiling documentation ( #10072 )
2022-12-02 11:34:30 +08:00
c91f7e3952
Fix Elasticsearch storage: In the merged index, column's property `indexOnly` not applied and cannot be updated. ( #10060 )
2022-11-30 17:24:35 +08:00
2ac671cc1b
Fix wrong time bucket on attached event ( #10049 )
2022-11-30 10:22:52 +08:00
1335a48f1c
* Self-Observability: Add counters for metrics reading from DB or cached. Dashboard:`Metrics Persistent Cache Count`. ( #10050 )
...
* Self-Observability: Fix `GC Time` calculation.
* Add trace association for general service dashboards.
2022-11-29 20:59:12 +08:00
ad57481e88
update UI ( #10048 )
2022-11-29 19:11:20 +08:00
2d97e24ec5
Add docs for profiling, and adjust menu items. ( #10046 )
2022-11-29 17:27:02 +08:00
f0a7528e76
Adding HTTP/1.x metrics tab on network profiling widget ( #10044 )
2022-11-29 15:26:13 +08:00
6348f16b6b
Rename `BanyanDB.ShardingKey` to `BanyanDB.SeriesID` ( #10037 )
2022-11-26 13:06:53 +08:00
ce3196beff
Fix Elasticsearch storage: Query `sortMetrics` missing transform real index column name. ( #10036 )
2022-11-26 11:15:17 +08:00
6b60357324
Fix `BanyanDB.ShardingKey` annotation missed in the generated OAL metrics classes. ( #10032 )
2022-11-26 00:20:33 +08:00
1da72b6af9
Internal API: remove undocumented ElasticSearch API usage and use documented one ( #10031 )
2022-11-25 21:15:25 +08:00
65431ac786
sync ui ( #10030 )
2022-11-25 18:16:35 +08:00
f9e23eb329
Fix Elasticsearch storage: In `No-Sharding Mode`, add specific analyzer to the template before index creation to avoid update index error. ( #10026 )
2022-11-25 15:32:40 +08:00
8185589ac6
Add trace association for FAAS dashboards ( #10024 )
2022-11-25 10:08:29 +08:00
2fa821d9f5
Enhance cache mechanism in the metric persistent process ( #10021 )
2022-11-24 23:56:16 +08:00
9bdccc1daa
sync ui ( #10023 )
2022-11-24 22:08:46 +08:00
6a75de5ece
Add `@BanyanDB.TimestampColumn` to identify `which column in Record` is providing the timestamp(milliseconds) for BanyanDB ( #10019 )
2022-11-24 21:20:36 +08:00
2e7a850475
Support dynamic config the sampling strategy in network profiling. ( #10002 )
2022-11-23 15:33:20 +08:00
ffa4990938
[Feature] Zipkin module support BanyanDB storage. ( #10004 )
2022-11-22 22:38:38 +08:00
e5950cc062
Sync UI ( #9993 )
2022-11-21 12:30:26 +08:00
72d11de72b
Add default entity name(`_blank`) ( #9986 )
2022-11-18 17:37:32 +08:00
0a2ee589d5
Test: Add integration test for Shardingsphere-proxy ( #9969 )
...
* Fix `ShardingTopologyQueryDAO.loadServiceRelationsDetectedAtServerSide` miss serviceIds.
* Add sharding integration test.
2022-11-17 20:42:09 +08:00
94cf9238c7
Fix ESEventQueryDAO miss metric_table boolQuery criteria. ( #9971 )
2022-11-16 21:02:44 +08:00
973d30aa48
Fix SW_STORAGE_ES_SUPER_DATASET_DAY_STEP variable name ( #9970 )
2022-11-16 18:51:42 +08:00
4ae167b850
Fix not-time-series model blocking OAP boots in no-init mode. ( #9966 )
2022-11-16 17:23:22 +08:00
8dfd18ec20
fix: correct system variable spelling ( #9968 )
2022-11-16 16:21:34 +08:00
978599edc4
Add `LongText` to support longer logs persistent as a text type ( #9964 )
2022-11-16 13:28:57 +08:00
d3d756bf4a
Remove `lengthEnvVariable` for `Column` as it never works as expected ( #9952 )
2022-11-12 14:33:17 +08:00
7c8867bed7
Fix changelog for EventMesh plugin IDs ( #9948 )
2022-11-11 16:04:11 +08:00
671cb02982
Bump up Kafka client to 2.8.1 to fix CVE-2021-38153. ( #9949 )
2022-11-11 15:56:39 +08:00
03e8f8a994
Fix max length to 512 of IDs. ( #9947 )
2022-11-11 00:30:56 +08:00
109e6dea16
Support MySQL/PostgreSQL cluster mode ( #9937 )
2022-11-10 22:29:31 +08:00
22f6803b18
sync ui ( #9942 )
2022-11-10 15:40:26 +08:00
a386853bc9
Force UTF-8 encoding in `JsonLogHandler` of `kafka-fetcher-plugin`. ( #9927 )
2022-11-09 14:00:19 +08:00
3122697e3a
Support span attached event concept ( #9916 )
2022-11-09 11:28:42 +08:00
48a0985345
Elasticsearch storage: support specify the settings `(number_of_shards/number_of_replicas)` for each index individually. ( #9914 )
...
* Elasticsearch storage: Provide system environment variable(`SW_STORAGE_ES_SPECIFIC_INDEX_SETTINGS`) and support specify the settings `(number_of_shards/number_of_replicas)` for each index individually.
* Elasticsearch storage: Support update index settings `(number_of_shards/number_of_replicas)` for the index template after re-configured.
2022-11-07 21:16:36 +08:00
2e3134952e
Refactor jdbc storage implementations to reuse logics ( #9904 )
2022-11-07 20:02:24 +08:00
f38aad5fa5
Optimize MQ Topology analysis. ( #9911 )
...
Use entry span's peer from the consumer side as source service when no producer instrumentation(no cross-process reference).
2022-11-06 17:24:26 +08:00
d32a318637
Update BanyanDB storage module to adapt BanyanDB 0.2 ( #9839 )
...
* update to banyandb client 0.2
* simplify group check and creation
* support indexOnly
* partial apply configuration
* support CompleteableFuture
* fix BanyanDBProfileThreadSnapshotQueryDAO
* optimize BanyanDBProfileTaskQueryDAO
* optimize *LogQueryDAO
* support indexType
* add configuration
* use TTL from core config
Signed-off-by: Megrez Lu <lujiajing1126@gmail.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-11-04 11:33:21 +08:00
cba0e6182e
Reduce the buffer size(queue) of MAL(only) metric streams ( #9897 )
2022-11-02 20:26:38 +08:00
828e6e2f2b
Add virtual MQ analysis for native traces ( #9855 )
2022-11-02 08:05:35 +08:00
93db461216
Add UI dashboard for Python runtime metrics ( #9863 )
2022-11-02 07:04:33 +08:00
e497efd245
Change the way of loading MAL rules ( #9822 )
2022-11-01 15:11:04 +08:00
4adc05f89c
Support `sampledTrace` in LAL ( #9857 )
2022-10-31 17:54:37 +08:00
ae6a3a18ef
sync ui ( #9867 )
...
* Fix configuration panel styles.
* Remove an un-use icon.
* Support labeled value on the service/instance/endpoint list widgets.
2022-10-31 12:06:43 +08:00
fb2ac0e7f9
Split TCP related service mesh metrics protobuffer definition ( #9851 )
2022-10-28 09:14:38 +08:00
9ba31b63a2
Do not log error logs when failed to create ElasticSearch index because the index is created already ( #9856 )
2022-10-27 23:49:13 +08:00
7f9f792229
Do not log grpc envoy receiver client-side streaming cancellation as errors ( #9843 )
2022-10-26 07:32:34 +08:00
2cdcb0d7cc
Sync ui ( #9841 )
2022-10-25 12:17:26 +08:00
24f8d6fbaa
Remove improper self-obs metrics in JvmMetricsHandler(for Kafka channel) ( #9838 )
2022-10-25 07:42:06 +08:00
9d3982db74
Add new config initialization mechanism of module provider to replace existing ( #9828 )
2022-10-22 19:07:53 +08:00
2e6e3faef0
Support new records query protocol ( #9827 )
2022-10-22 11:30:52 +08:00
b0d82d5604
[feat]Add Golang runtime metrics and cpu/memory used rate panels in FaaS-Instance dashboard ( #9823 )
2022-10-22 09:47:48 +08:00
2bde958f49
Update document `Server Agents` and `Compatibility` for PHP agent. ( #9830 )
2022-10-22 08:57:40 +08:00
6ea51f1745
Bump up jackson databind, snakeyaml, grpc dependencies ( #9821 )
2022-10-21 09:50:20 +08:00
d98775790a
Support export `Trace` and `Log` through Kafka. ( #9817 )
2022-10-21 08:04:18 +08:00
8d49b88259
Update docs for new data-collecting and query protocols ( #9809 )
2022-10-19 14:52:56 +08:00
b5cd3fad7e
Support `sumPerMinLabeled` in `MAL` ( #9804 )
2022-10-19 13:50:58 +08:00
34cfafe398
Update changes.md ( #9790 )
2022-10-15 18:01:13 +08:00
5e275b1bf2
Fix metrics was put into wrong slot of the window in the alarting kernel ( #9789 )
2022-10-15 17:32:42 +08:00
32b0d362f2
Optimize the query time of tasks in ProfileTaskCache ( #9780 )
2022-10-13 19:27:26 +08:00
956a9ec973
Lazy load the Kubernetes metadata and switch from event-driven to polling ( #9747 )
2022-10-11 23:38:00 +08:00
4752d7b74e
optimize the creation conditions of profiling task ( #9744 )
2022-10-10 11:35:03 +08:00
001a2ec454
(Summer 2022)Feat add golang runtime metrics ( #9711 )
2022-10-10 07:59:44 +08:00
f1e0558ce3
Limit the max length of trace and log tag's `key=value` ( #9741 )
2022-10-08 16:12:48 +08:00
f513161910
Add Security Notice doc ( #9737 )
2022-10-08 09:16:51 +08:00
ba84b8af3e
Support skywalking-client-js report empty `service version` and `page path` ( #9735 )
2022-10-07 21:09:24 +08:00
8aa046b8d7
Add APISIX metrics monitoring ( #9725 )
2022-10-05 18:23:37 +08:00
dd6b7a1fc0
Remove Prometheuse fetcher, fix MAL Histogram type bug, and reorganize the doc ( #9710 )
...
* [**Breaking Change**]: Remove prometheus-fetcher plugin, please use OpenTelemetry to scrape Prometheus metrics and
set up SkyWalking OpenTelemetry receiver instead.
* BugFix: histogram metrics sent to MAL should be treated as OpenTelemetry style, not Prometheus style:
```
(-infinity, explicit_bounds[i]] for i == 0
(explicit_bounds[i-1], explicit_bounds[i]] for 0 < i < size(explicit_bounds)
(explicit_bounds[i-1], +infinity) for i == size(explicit_bounds)
```
2022-09-30 13:13:03 +08:00
d7ee9a01d6
Support sharding MySQL database instances and tables. ( #9689 )
...
* [**Breaking Change**] Support sharding MySQL database instances and tables by [Shardingsphere-Proxy](https://shardingsphere.apache.org/document/current/en/overview/#shardingsphere-proxy ).
SQL-Database requires removing tables `log_tag/segment_tag/zipkin_query` before OAP starts, if bump up from previous releases.
2022-09-30 08:39:14 +08:00
f41b41ed21
Polish academy docs ( #9707 )
2022-09-29 10:12:17 +08:00
4a7e8191dd
Unify query services and DAOs codes time range condition to `Duration`. ( #9702 )
2022-09-29 08:08:15 +08:00
fba069f4fb
Fix the wrong watch semantics in Kubernetes watchers ( #9551 )
2022-09-28 08:01:38 +08:00
4f20059f7c
Fix words ( #9694 )
2022-09-27 16:32:57 +08:00
2c265db6e8
Fix two kernel level bugs. ( #9690 )
...
* Fix meter functions `avgHistogram`, `avgHistogramPercentile`, `avgLabeled`, `sumHistogram` having data conflict when downsampling. FYI @jinho-son thanks for reporting.
* Do sorting `readLabeledMetricsValues` result forcedly in case the storage(database) doesn't return data consistent with the parameter list.
2022-09-27 16:05:17 +08:00
f9db9ba2dc
Support monitoring PostgreSQL slow SQLs. ( #9673 )
2022-09-23 20:31:17 +08:00
9a674c95cb
Bump up the embedded `swctl` version in OAP Docker image ( #9649 )
2022-09-21 15:29:00 +08:00
a39f0308b6
Sync ui and add a document for adding menus to booster UI ( #9653 )
...
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2022-09-21 12:37:14 +08:00
3e3a39cb66
Bump up snakeyaml to 1.32 ( #9647 )
2022-09-20 21:56:24 +08:00
371bdab5ec
Remove `responseCode` fields of all OAL sources, as well as examples to avoid user's confusion. ( #9638 )
2022-09-20 10:27:26 +08:00
ebb42441ec
Add `metadata-uid` setup doc about Kubernetes coordinator ( #9636 )
2022-09-20 09:56:18 +08:00
bbe0a7c4c2
Support analyzing cache related spans to provide metrics and slow commands for cache services from client side. ( #9622 )
...
* Support analyzing cache related spans to provide metrics and slow commands for cache services from client side
* Optimize virtual database, fix dynamic config watcher NPE when default value is null
* [UI] Add virtual cache dashboard
2022-09-19 22:10:32 +08:00
c3e0b12648
[Critical] Remove physical index existing check and fix TTL activation bug ( #9632 )
...
* Remove physical index existing check
* Make sure instance list ordered in TTL processor to avoid TTL timer never runs.
2022-09-19 19:37:03 +08:00
0a85bc43b7
Support monitoring MySQL slow SQLs ( #9614 )
2022-09-16 23:44:57 +08:00
d3727b7a9f
Enhance LAL to support convert LogData to DatabaseSlowStatement. ( #9575 )
2022-09-16 12:42:43 +08:00
f38ff09e6c
sync ui ( #9611 )
...
* Polish the endpoint list graph.
* Fix styles for an adaptive height.
* Fix setting up a new time range after clicking the refresh button.
* Enhance the process topology graph to support dragging nodes.
2022-09-16 07:40:26 +08:00
dd3a45e4e7
UI-template: Fix metrics calculation in `general-service/mesh-service/faas-function` top-list dashboard. ( #9610 )
...
* Fix metrics calculation in `general-service/mesh-service/faas-function` top-list dashboard
* changes.md
2022-09-16 07:33:14 +08:00
04c4fedf43
Adapt ElasticSearch 8.1+, migrate from removed APIs to recommended APIs ( #9603 )
2022-09-14 12:22:40 +08:00
12a18e6977
Add layer property to LAL script ( #9593 )
2022-09-12 22:16:07 +08:00
Superskyyy
weixiang1862
吴晟 Wu Sheng
Wan Kai
kezhenxu94
Jedore
mrproliu
Marc Navarro
Marc Navarro
Jiekun
Fine0830
yswdqz
innerpeacez
xu1009
好久不见
gzlicanyi
Jiajing LU
pg.yang
jmjoy
Fine0830
Brandon Fergerson
guochen2
Gao Hongtao
叶梦飞
XinweiLyu
Hper
Shichao
wuwen
inversionhourglass
alidisi
Raigor
zhyyu
Mahmoud Anwer
Marcin Grzejszczak
zhang-wei
heihei180
jiang1997
Eason Yi
jmjoy
yangyiweigege
xzyJavaX