Commit Graph

1114 Commits

Author SHA1 Message Date
kezhenxu94 d557f547fa
Fix potential NPE in OAL string match and a bug when right-hand-side variable includes double quotes (#8234) 2021-12-02 22:08:40 +08:00
吴晟 Wu Sheng e7d6f89021
Set the version to 8.10.0, 8.9.0 release is in process. (#8233) 2021-12-02 18:54:21 +08:00
吴晟 Wu Sheng df75eb7d97
Fix a wrong check about entity if GraphQL at the endpoint relation level. (#8218) 2021-12-01 09:28:21 +08:00
Daniel Qian e2d1ff435a
StorageModuleElasticsearchProvider doesn't watch on TrustStorePath (#8205)
Ref https://github.com/apache/skywalking/discussions/8204
2021-11-30 11:27:45 +08:00
mrproliu 1acba5d246
Remove `logback` dependencies in IoTDB plugin (#8202) 2021-11-29 18:02:54 +08:00
mrproliu 5cdd4ed50f
Introduce the Customized ALS Protocol for Satellite (#8193) 2021-11-28 22:30:12 +08:00
刘威 842b5d927e
Support Apache IoTDB as a storage option (#7766)
Support Apache IoTDB as a storage option, mostly refer to previous InfluxDB storage option.
* The Design of Apache IoTDB Storage Option, https://skywalking.apache.org/blog/2021-11-23-design-of-iotdb-storage-option/
2021-11-27 09:04:23 +08:00
刘威 6529c1d7ae
fix TopologyQuery.loadEndpointRelation bug in InfluxDB storage (#8187) 2021-11-26 23:18:16 +08:00
吴晟 Wu Sheng cef4f6dcac
A polish for comment. (#8178) 2021-11-24 12:56:15 +08:00
xuxiawei 7cf82f318e
Fix incorrect use of ReentrantLock in GRPCExporter (#8177)
fix that an imse (IllegalMonitorStateException) exception will be thrown when finally releasing the lock when an exception occurs in lock() locking
2021-11-24 12:02:20 +08:00
liqiangz 8436135dc9
Add MeterReportService collectBatch method. (#8165) 2021-11-22 22:11:39 +08:00
kezhenxu94 7b2d91a3d7
Remove filter for Istiod monitor to reduce the prerequisites of job name matching (#8162) 2021-11-21 20:04:53 +08:00
kezhenxu94 a2897db471
Fix the so11y latency of persistence execution latency not correct in ElasticSearch storage (#8161)
The ES persistence execution is now asynchronous and the execution
latency only counts the time to insert the requests into the bulk
processor, instead of the time after the requests are flushed into the
storage, this patch fixes that issue.

There is the same issue in prepare latency but that needs more changes
so I'll leave it to another pull request.
2021-11-20 16:51:54 +08:00
kezhenxu94 973fba0805
Add filter mechanism in MAL core and fix some bugs (#8157) 2021-11-19 23:33:35 +08:00
mrproliu b2e8438820
Change `SO11Y` metric `envoy_als_in_count` to calculate the ALS message count. (#8150)
* Change `SO11Y` metric `envoy_als_in_count` to calculate the ALS message count.
2021-11-19 13:03:59 +08:00
吴晟 Wu Sheng f1127a726e
Fix the incorrect place of Long declaration (#8135) 2021-11-16 20:24:57 +08:00
Kirs 4284a57501
Add MicroBench module to make it easier for developers to write JMH Test (#7985) 2021-11-11 12:01:40 +08:00
吴晟 Wu Sheng c0994eefde
Optimize metrics of minute dimensionality persistence, don't save metric of being default value. (#8066)
Optimize metrics of minute dimensionality persistence.
- The value of metrics, which has declaration of the default value and current value equals the default value logically, the whole row wouldn't be pushed into database.
- Add self-observability `metrics_persistence_skipped` metric to measure the number of skipped metrics.
- SLA(percent function), Apdex, AvgLong(MAL mostly) metrics are mostly optimized because of this. Such as a full-failing error(0% successful rate) and unhealthy(apdex=0) are not costing the storage.
- Hour/Day dimensionalities metrics are not changed, as they cover long duration.
- Fix `max` function in OAL doesn't support negative long.
2021-11-04 09:38:18 +08:00
zhyyu 149b359ca6
fix config yaml data type conversion bug (#8035)
Co-authored-by: yuzhongyu <yuzhongyu@cestc.cn>
2021-10-29 21:35:17 +08:00
吴晟 Wu Sheng 50cc044571
Make new TimeBucket in ElasticSearch compatible with old versions. (#8027) 2021-10-28 10:18:01 +08:00
吴晟 Wu Sheng 2ea12934ce
Fix ElasticSearch implementation of `queryMetricsValues` and `readLabeledMetricsValues` doesn't fill default values (#8012)
* Fix ElasticSearch implementation of `queryMetricsValues` and `readLabeledMetricsValues` doesn't fill default values
* Change generated file path.
2021-10-27 08:27:09 +08:00
Kirs f7bcb76784
move the codes in apm-commons into server-library (#8003) 2021-10-26 20:31:36 +08:00
吴晟 Wu Sheng 3aedfcc4a8
Fix TimeBucket missing in H2, MySQL, TiDB and PostgreSQL bug (#8008) 2021-10-26 19:44:00 +08:00
吴晟 Wu Sheng e575701f85
Support JDK 16 and 17. (#8005) 2021-10-26 16:34:24 +08:00
kezhenxu94 a5685cb149
Add a GraphQL query to get OAP version, display OAP version in startup message and error logs (#8004) 2021-10-26 15:05:37 +08:00
吴晟 Wu Sheng a68503b39f
Fix unexpected deleting due to TTL mechanism bug (#8000) 2021-10-25 22:55:42 +08:00
wankai123 d1dcd3f96c
Replace e2e cases to e2e-v2: Kafka: Base, Meter, Log, Profile (#7986)
* Replace e2e cases to e2e-v2: Kafka: Base, Meter, Log, Profile
* Set `SW_KAFKA_FETCHER_ENABLE_NATIVE_PROTO_LOG`, `SW_KAFKA_FETCHER_ENABLE_NATIVE_JSON_LOG` default `true`.
2021-10-22 10:54:49 +08:00
mrproliu 8d24ba2d9f
Add `getProfileTaskLogs` query method implement (#7984) 2021-10-22 08:20:10 +08:00
zhang-wei 929dc0e91f
support search browser service (#7975) 2021-10-21 15:22:43 +08:00
kezhenxu94 ca539e7ddb
Fix setting wrong field when combining `Event`s (#7953) 2021-10-19 07:14:15 +08:00
mrproliu 605ca03884
support negative infinity bucket in meter system (#7930) 2021-10-15 17:47:44 +08:00
吴晟 Wu Sheng fc0d0e1e7b
Message Queue performance and consuming latency monitoring (#7918)
* Support `!= null` in OAL engine.
* Add `Message Queue Consuming Count` metric for MQ consuming service and endpoint.
* Add `Message Queue Avg Consuming Latency` metric for MQ consuming service and endpoint.
* Document with a new menu in the `tracing` catalog is added
2021-10-13 20:20:36 +08:00
吴晟 Wu Sheng 720dc924e4
Refactor the OAL compiler context to improve readability (#7913)
* Refactor the OAL compiler context to improve readability. Usually, this could not be included in the change log, but considering this kind of refactor could cause not-found bugs, Adding this as a hit if we face some related issues in the future.
* Fix wrong generated codes of hashCode and remoteHashCode methods for numeric fields.
2021-10-12 19:04:28 +08:00
吴晟 Wu Sheng 7f7f604bed
Support `(str->long)` and `(str->int)` cast statements in OAL core engine. (#7907)
Enhance OAL engine core
* Fix `funcParamExpression` and `literalExpression` can't be used in the same aggregation function.
* Support cast statement in the OAL core engine.
* Support `(str->long)` and `(long)` for string to long cast statement.
* Support `(str->int)` and `(int)` for string to int cast statement.
* Support Long literal number in the OAL core engine.
* Support literal `string` as parameter of aggregation function.
* Add `attributeExpression` and `attributeExpressionSegment` in the OAL grammar tree to support `map` type for the
  attribute expression.

Besides added UTs, I locally tested these OAL scripts
```
mq_consume_latency = from((str->long)Service.tag["transmission.latency"]).longAvg();

mq_consume_latency = from((long)Service.tag["transmission.latency"]).longAvg();

mq_consume_latency = from((str->long)Service.tag["transmission.latency"]).filter((str->long)tag["transmission.latency"] > 0L).longAvg();
```
2021-10-12 14:33:23 +08:00
royal-dargon d96192810e
add:add the component-libraries about golang (#7906) 2021-10-12 00:32:31 +08:00
吴晟 Wu Sheng 9d8a774b6a
Enhance `get` generation mechanism of OAL engine, support map type of source's field. (#7904) 2021-10-11 21:04:06 +08:00
xu1009 6452e0c2d9
add kylin plugin component id (#7888) 2021-10-11 12:10:14 +08:00
吴晟 Wu Sheng 8351961315
Remove component definitions in Java codes. (#7893)
* Remove component definitions in Java codes. component-libraries.yml controls the ownership now.

* Remove useless codes.
2021-10-11 00:37:03 +08:00
wallezhang 615bac817e
feat: Add ClickHouse ID in component-libraries.yml (#7865) 2021-10-09 12:26:14 +08:00
kezhenxu94 508945f552
Upgrade Armeria to 1.12, upgrade OpenSearch test version to 1.1.0 (#7866) 2021-10-08 19:45:33 +08:00
kezhenxu94 da9b79ca30
Fix zipkin receiver is not packaged into dist (#7843) 2021-09-30 13:51:51 +08:00
业余布道师 3517cf245a
Add component definition for Jackson. (#7813) 2021-09-29 22:16:58 +08:00
吴晟 Wu Sheng 55de557acf
Revert mis-change, which makes the endpoint dependency breaking. (#7829)
* Revert mis-change, which makes the endpoint dependency breaking.

* Update change log.
2021-09-29 09:06:29 +08:00
kezhenxu94 a4c68d30d8
test: fix that E2E is not run, also add ElasticSearch 7.15 to test matrix (#7826) 2021-09-28 21:57:19 +08:00
Jared Tan c53ee801e7
Remove unused defines (#7807) 2021-09-26 21:41:01 +08:00
吴晟 Wu Sheng 8b681053df
Begin 8.9.0 iteration (#7801)
* [maven-release-plugin] prepare release v8.8.0

* [maven-release-plugin] prepare for next development iteration

* Create changes-8.8.0.md

* Reset changelog for 8.9.0
2021-09-25 23:46:18 +08:00
kezhenxu94 ad9d616297
Add `socketTimeout` back to the new implementation (#7798) 2021-09-24 22:35:56 +08:00
吴晟 Wu Sheng b7ba282a58
Fix entity naming mechanism failure in MAL (#7790) 2021-09-24 19:34:56 +08:00
业余布道师 ba5aa685c7
Add component definition for Fastjson. (#7788) 2021-09-24 13:48:44 +08:00
吴晟 Wu Sheng 8f9a19213c
Fix `Hour`/`Day` dimensionality metrics and `Slow SQL sampling` are not accurate (#7787) 2021-09-24 13:32:30 +08:00