dc05539361
DataCarrier changes a `#consume` API to add properties as a parameter to initialize consumer ( #7452 )
2021-08-13 14:05:10 +08:00
6a241aed75
[Break Change] Remove endpoint name in backend log and browser log query ( #7444 )
...
* Remove page path in the browser log query condition.
* Remove endpoint name in the backend log query condition.
2021-08-12 09:44:19 +08:00
de6cae3429
[Break Change] Remove endpoint name in the trace query condition. ( #7438 )
...
* [Break Change] Remove endpoint name in the trace query condition.
* Fix a local UT error(MacOS only)
2021-08-11 16:27:10 +08:00
cc66254729
Remove statement, version, and endtime from segment entity. ( #7427 )
2021-08-10 00:05:06 +08:00
1c5e22a7be
Begin 8.8.0 iteration ( #7395 )
...
* [maven-release-plugin] prepare release v8.7.0
* [maven-release-plugin] prepare for next development iteration
2021-07-30 23:01:09 +08:00
ffc69dc6f3
ES storage support set order of index template. ( #7378 )
2021-07-27 20:13:31 +08:00
ea76335527
Avoid "select *" query ( #7372 )
2021-07-27 15:50:55 +08:00
383e32b44b
Fix the persistent session timeout mechanism bug. ( #7347 )
2021-07-22 05:50:19 +08:00
3a4ee08e54
Enhance persistent session timeout mechanism. ( #7334 )
...
Fix bug, the enhanced session could cache the metadata metrics(hot entity) forever. A new timeout mechanism is designed for avoiding this specific case.
Optimize this timeout mechanism, make it different for ES(one index per day) and non-ES storage implementation.
2021-07-20 07:50:27 +08:00
8df362b929
Adjust ElasticSearch index refresh period as INT(flushInterval * 2/3) ( #7310 )
...
Adjust index refresh period as INT(flushInterval * 2/3), it used to be as same as bulk flush period. At the edge case, in low traffic(traffic < bulkActions in the whole period), there is a possible case, 2 period bulks are included in one index refresh rebuild operation, which could cause version conflicts. And this case can't be fixed through core/persistentPeriod as the bulk fresh is not controlled by the persistent timer anymore.
This PR should avoid the following exception in the low load case, especially when bulkActions is set larger than the number of a metric type.
2021-07-16 12:10:35 +08:00
408bbf86e6
Fix a misused variable. ( #7309 )
2021-07-15 19:31:50 +08:00
c59ee90029
Performance: optimize IDs read of ElasticSearch storage options(6 and 7) ( #7307 )
...
* Performance: optimize IDs read of ElasticSearch storage options(6 and 7). Use the physical index rather than template alias name.
2021-07-15 18:06:11 +08:00
de975c7e2b
Remove synchronous persistence mechanism in API level and ElasticSearch implementation ( #7293 )
...
* Performance: remove the synchronous persistence mechanism from batch ElasticSearch DAO. Because the current enhanced persistent session mechanism, don't require the data queryable immediately after the insert and update anymore.
* Performance: share `flushInterval` setting for both metrics and record data, due to `synchronous persistence mechanism` removed. Record flush interval used to be hardcoded as 10s.
* Remove `syncBulkActions` in ElasticSearch storage option.
* Increase the default bulkActions(env, SW_STORAGE_ES_BULK_ACTIONS) to 5000(from 1000).
* Increase the flush interval of ElasticSearch indices to 15s(from 10s)
Add these 2 references. According to these, **(same _index, _type and _id) in same bulk will be in order**
1. https://github.com/elastic/elasticsearch/issues/50199
2. https://discuss.elastic.co/t/order-of--bulk-request-operations/98124
Notice, the order of different bulks is not guaranteed by the ElasticSearch cluster. We are going to have the risk of dirty write. But consider we set over 20s period between flush, and index flush period is 10, we should be safe.
Recommend 5000 bulk size and 15s flush interval only. The persistent period has been set to 25s.
2021-07-14 17:19:49 +08:00
d79094c178
Add pagination to event query ( #7274 )
2021-07-09 23:04:50 +08:00
022bf38116
Fix InfluxDB storage-plugin Metrics#multiGet issue ( #7238 )
2021-07-03 13:58:27 +08:00
536b7d2328
Support connectTimeout and socketTimeout settings ( #7214 )
2021-07-01 08:20:59 +08:00
528ee6de40
OAL supports generating metrics from events ( #7134 )
...
* OAL supports generating metrics from events
* Add new dashboard for event metrics
* Add some docs for event metrics
2021-06-19 20:20:37 +08:00
402902f75c
Agent supports the collection of JVM arguments and jar dependencies information. ( #7069 )
2021-06-17 15:30:44 +08:00
5eb1021639
Initialize 8.7.0 iteration ( #7078 )
2021-06-08 07:41:09 +08:00
bb590daba9
Include event(s) to alarms. ( #6888 )
...
Co-authored-by: kezhenxu94 <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-05-19 14:14:48 +08:00
3b15f8d132
feature: Envoy access log receiver supports TCP logs ( #6727 )
2021-05-07 07:50:03 +08:00
7a53331367
Support alarm tags ( #6820 )
2021-04-25 17:22:43 +08:00
1fb2b01b7e
fix: Receiver_zipkin missing ServiceInstanceID bug #6749 ( #6763 )
2021-04-19 11:55:43 +08:00
17e820f156
Begin 8.6.0 iteration ( #6721 )
2021-04-09 23:01:00 +08:00
58854af662
Fix slash root issues in es7 client ( #6707 )
...
Signed-off-by: Gao Hongtao <hanahmily@gmail.com>
2021-04-08 11:19:00 +08:00
2af77d4d03
make sync metrics concurrency ( #6642 )
...
* make sync metrics concurrency
* add changelog
* add changelog
* polish codes
* change default value
* remove unnecessary codes
Co-authored-by: Evan <evanljp@outlook.com>
Co-authored-by: Zhenxu Ke <kezhenxu94@apache.org>
Co-authored-by: 吴晟 Wu Sheng <wu.sheng@foxmail.com>
2021-04-02 11:33:46 +08:00
bfef6d9120
Fix typos ( #6568 )
2021-03-18 09:58:47 +08:00
fd1d21021f
[Incompatible Enhancement]New index policy of ElasticSearch storage option ( #6499 )
2021-03-11 15:11:37 +08:00
0382447749
Fix tags store of log and trace on h2/mysql/pg storage ( #6505 )
2021-03-11 10:40:54 +08:00
e9196b7e20
remove meaningless code ( #6508 )
2021-03-08 12:37:10 +08:00
0e1d5c3767
Make Zipkin trace query available ( #6454 )
2021-02-27 14:50:54 +08:00
c45bb361ee
Storage plugin supports PostgreSQL ( #6345 )
2021-02-20 20:59:51 +08:00
1adea8a16e
Delete Es7DAO.java ( #6397 )
2021-02-19 07:52:27 +08:00
ba6d49ad91
Update the timestamp field type for LogQuery ( #6335 )
2021-02-07 12:09:51 +08:00
5e8f1eb552
Support multiple implementations of StorageBuilder in different storage implementations - stage 2 ( #6336 )
2021-02-07 10:37:14 +08:00
fc23dabf37
Support multiple implementations of StorageBuilder in different storage implementations - stage 1. ( #6334 )
2021-02-06 21:22:58 +08:00
b92eac2cd6
Add a new concept "Event" and its implementations to collect events ( #6183 )
2021-02-05 18:37:18 +08:00
d4ea997523
chore: add @Override tag on some methods ( #6304 )
2021-02-03 09:46:57 +08:00
cdfe6ab358
Begin the 8.5.0 iteration ( #6302 )
...
* [maven-release-plugin] prepare release v8.4.0
* [maven-release-plugin] prepare for next development iteration
2021-02-02 08:01:49 +08:00
93165abc2a
Multiple exclude and include query conditions don't work as expected. ( #6295 )
2021-02-01 00:33:20 +08:00
5d47d4d29f
Remove state / isError and collect exception stacktrace in error logs ( #6275 )
2021-01-30 08:18:52 +08:00
01d1eff6c7
Enhancement log-recerive e2e test ( #6248 )
2021-01-29 00:07:16 +08:00
e138d29778
add text analyzer for es ( #6249 )
2021-01-25 17:01:43 +08:00
0bd8149596
LogQuery remove unused field ( #6246 )
2021-01-24 19:13:31 +08:00
98d0430b91
chore: set up license-eye to check license header ( #6200 )
2021-01-14 22:08:37 +08:00
15452025c6
Log collecting and query implementation ( #6120 )
2021-01-14 09:49:11 +08:00
e3fbb3f705
Fix some influxdb plugin bug ( #6139 )
2021-01-08 14:49:44 +08:00
6e48dca99a
Improvement Influxdb query performance ( #6066 )
2020-12-30 19:54:33 +08:00
8899930082
fix influx query error #6056 ( #6057 )
...
* fix influx query error
* use InfluxConstants.NAME
2020-12-22 20:25:36 +08:00
8d33f0275e
chore: code polish ( #6025 )
2020-12-17 22:54:36 +08:00
吴晟 Wu Sheng
pkxiuluo
LEE
Ax1an
kezhenxu94
Daming
Ax1an
chen~
liqiangz
kl
Gao Hongtao
Evan
Jingguo Yao
hailin0
mantuliu
haoyann
Brandon Fergerson
zhang-wei
Stephen Ni
cuiweiwei
songzhe