de975c7e2b
Remove synchronous persistence mechanism in API level and ElasticSearch implementation ( #7293 )
...
* Performance: remove the synchronous persistence mechanism from batch ElasticSearch DAO. Because the current enhanced persistent session mechanism, don't require the data queryable immediately after the insert and update anymore.
* Performance: share `flushInterval` setting for both metrics and record data, due to `synchronous persistence mechanism` removed. Record flush interval used to be hardcoded as 10s.
* Remove `syncBulkActions` in ElasticSearch storage option.
* Increase the default bulkActions(env, SW_STORAGE_ES_BULK_ACTIONS) to 5000(from 1000).
* Increase the flush interval of ElasticSearch indices to 15s(from 10s)
Add these 2 references. According to these, **(same _index, _type and _id) in same bulk will be in order**
1. https://github.com/elastic/elasticsearch/issues/50199
2. https://discuss.elastic.co/t/order-of--bulk-request-operations/98124
Notice, the order of different bulks is not guaranteed by the ElasticSearch cluster. We are going to have the risk of dirty write. But consider we set over 20s period between flush, and index flush period is 10, we should be safe.
Recommend 5000 bulk size and 15s flush interval only. The persistent period has been set to 25s.
2021-07-14 17:19:49 +08:00
d79094c178
Add pagination to event query ( #7274 )
2021-07-09 23:04:50 +08:00
022bf38116
Fix InfluxDB storage-plugin Metrics#multiGet issue ( #7238 )
2021-07-03 13:58:27 +08:00
536b7d2328
Support connectTimeout and socketTimeout settings ( #7214 )
2021-07-01 08:20:59 +08:00
528ee6de40
OAL supports generating metrics from events ( #7134 )
...
* OAL supports generating metrics from events
* Add new dashboard for event metrics
* Add some docs for event metrics
2021-06-19 20:20:37 +08:00
402902f75c
Agent supports the collection of JVM arguments and jar dependencies information. ( #7069 )
2021-06-17 15:30:44 +08:00
5eb1021639
Initialize 8.7.0 iteration ( #7078 )
2021-06-08 07:41:09 +08:00
bb590daba9
Include event(s) to alarms. ( #6888 )
...
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-05-19 14:14:48 +08:00
3b15f8d132
feature: Envoy access log receiver supports TCP logs ( #6727 )
2021-05-07 07:50:03 +08:00
7a53331367
Support alarm tags ( #6820 )
2021-04-25 17:22:43 +08:00
1fb2b01b7e
fix: Receiver_zipkin missing ServiceInstanceID bug #6749 ( #6763 )
2021-04-19 11:55:43 +08:00
17e820f156
Begin 8.6.0 iteration ( #6721 )
2021-04-09 23:01:00 +08:00
58854af662
Fix slash root issues in es7 client ( #6707 )
...
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2021-04-08 11:19:00 +08:00
2af77d4d03
make sync metrics concurrency ( #6642 )
...
* make sync metrics concurrency
* add changelog
* add changelog
* polish codes
* change default value
* remove unnecessary codes
Co-authored-by: Evan <evanljp@outlook.com>
Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-04-02 11:33:46 +08:00
bfef6d9120
Fix typos ( #6568 )
2021-03-18 09:58:47 +08:00
fd1d21021f
[Incompatible Enhancement]New index policy of ElasticSearch storage option ( #6499 )
2021-03-11 15:11:37 +08:00
0382447749
Fix tags store of log and trace on h2/mysql/pg storage ( #6505 )
2021-03-11 10:40:54 +08:00
e9196b7e20
remove meaningless code ( #6508 )
2021-03-08 12:37:10 +08:00
0e1d5c3767
Make Zipkin trace query available ( #6454 )
2021-02-27 14:50:54 +08:00
c45bb361ee
Storage plugin supports PostgreSQL ( #6345 )
2021-02-20 20:59:51 +08:00
1adea8a16e
Delete Es7DAO.java ( #6397 )
2021-02-19 07:52:27 +08:00
ba6d49ad91
Update the timestamp field type for LogQuery ( #6335 )
2021-02-07 12:09:51 +08:00
5e8f1eb552
Support multiple implementations of StorageBuilder in different storage implementations - stage 2 ( #6336 )
2021-02-07 10:37:14 +08:00
fc23dabf37
Support multiple implementations of StorageBuilder in different storage implementations - stage 1. ( #6334 )
2021-02-06 21:22:58 +08:00
b92eac2cd6
Add a new concept "Event" and its implementations to collect events ( #6183 )
2021-02-05 18:37:18 +08:00
d4ea997523
chore: add @Override tag on some methods ( #6304 )
2021-02-03 09:46:57 +08:00
cdfe6ab358
Begin the 8.5.0 iteration ( #6302 )
...
* [maven-release-plugin] prepare release v8.4.0
* [maven-release-plugin] prepare for next development iteration
2021-02-02 08:01:49 +08:00
93165abc2a
Multiple exclude and include query conditions don't work as expected. ( #6295 )
2021-02-01 00:33:20 +08:00
5d47d4d29f
Remove state / isError and collect exception stacktrace in error logs ( #6275 )
2021-01-30 08:18:52 +08:00
01d1eff6c7
Enhancement log-recerive e2e test ( #6248 )
2021-01-29 00:07:16 +08:00
e138d29778
add text analyzer for es ( #6249 )
2021-01-25 17:01:43 +08:00
0bd8149596
LogQuery remove unused field ( #6246 )
2021-01-24 19:13:31 +08:00
98d0430b91
chore: set up license-eye to check license header ( #6200 )
2021-01-14 22:08:37 +08:00
15452025c6
Log collecting and query implementation ( #6120 )
2021-01-14 09:49:11 +08:00
e3fbb3f705
Fix some influxdb plugin bug ( #6139 )
2021-01-08 14:49:44 +08:00
6e48dca99a
Improvement Influxdb query performance ( #6066 )
2020-12-30 19:54:33 +08:00
8899930082
fix influx query error #6056 ( #6057 )
...
* fix influx query error
* use InfluxConstants.NAME
2020-12-22 20:25:36 +08:00
8d33f0275e
chore: code polish ( #6025 )
2020-12-17 22:54:36 +08:00
957d549b68
[ISSUE 5541] Fix H2 in-memory database table missing issues ( #6008 )
...
* add ;DB_CLOSE_DELAY=-1 to the database URL
* Update CHANGES log
* add ;DB_CLOSE_DELAY=-1 to the H2 database URL of application.yml
Co-authored-by: zhanglei36 <zhanglei36@asiainfo.com>
2020-12-15 16:05:03 +08:00
e792da1782
fix influxdb bug while setting influxdb connection response format as InfluxDB.ResponseFormat.JSON ( #5946 )
2020-12-07 22:56:03 +08:00
af19c72a7e
8.3.0 tagged, open for 8.3.0 iteration. ( #5920 )
...
* [maven-release-plugin] prepare release v8.3.0
* [maven-release-plugin] prepare for next development iteration
2020-11-29 11:01:20 +08:00
94b205f23a
fix index not found on trace query when using es7 ( #5911 )
...
* fix index not found on trace query when using es7
* add changelog
Co-authored-by: Evan <evanljp@outlook.com>
2020-11-27 16:59:21 +08:00
9a61835cb7
Fix influxdb config resubmit ( #5903 )
2020-11-26 19:14:48 +08:00
b39c4306a8
Observing Istio control plane ( #5835 )
...
* Add Istio control plane otel MAL expressions and UI template
* Remove OpenCensus receiver, add OpenTelemetry receiver
* Transfer oc receiver to ot receiver
* Create indices on boot
* Document istio metrics and otel receiver
* Update CHANGES.md
* Fix potential NPE
* Add group to meter and cleanup istio mixer
* Update e2e case due to the change of meter metric name
* Update prometheus fetcher config, fix sql builder issue of h2
* Disable istio and so11y metrics by default.
* Fix micrometer testcase
2020-11-25 21:07:03 +08:00
8d164d3dd8
Add Tidb provider module. ( #5844 )
...
* fix transaction too large error when use TiDB as storage
* add CHANGES.md
* fix typo
* add tidb storage provider module.
* add e2e.
* revert ui submodule.
* fix license.
* Fix wrong health check test
* add tidb ttl e2e.
Co-authored-by: moonsphere <moonsphere@m.com>
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: kezhenxu94 <kezhenxu94@163.com>
2020-11-22 23:28:54 +08:00
c9202af1ee
Support group in the service traffic and service list query. ( #5851 )
...
* Support group in the service traffic and service list query.
2020-11-17 22:45:32 +08:00
ef1363d928
remove unused min date timebucket in jdbc delethistory logical. ( #5845 )
...
* remove unused min date timebucket in jdbc delethistory logical.
* update CHANGES.md
2020-11-15 19:28:38 +08:00
3a2706d104
Fix storage-influxdb-plugin serviceCode query ( #5792 )
...
* Fix storage-influxdb-plugin serviceCode query
* Update CHANGES.md
Add the changelog for the PR as I have time.
Co-authored-by: yuanguohua <yuanguohua@fin-shine.com>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2020-11-04 19:39:06 +08:00
9042ce6fe2
fix storage-jdbc isExists not set dbname ( #5786 )
...
* fix null catalog
* update CHANGES.md
2020-11-04 11:37:54 +08:00
a9d756cd53
Fix deadlock problem when using elasticsearch-client-7.0.0 ( #5775 )
...
* Update elasticsearch client 7.0.0 to elasticsearch client 7.5.0.
* Update CHANGES.md and LICENSE.
2020-11-03 22:01:54 +08:00
吴晟 Wu Sheng
kezhenxu94
Daming
Ax1an
chen~
liqiangz
kl
Gao Hongtao
Evan
Jingguo Yao
hailin0
mantuliu
haoyann
Brandon Fergerson
zhang-wei
Stephen Ni
cuiweiwei
songzhe
Lei Zhang
jianweizhang
Jared Tan
gerry
zifeihan