Task #1159: Faster delete of logging events - IdStory Identity Manager

Actions

Copy link

Task #1159

closed

Faster delete of logging events

Added by Alena Peterová over 6 years ago. Updated over 6 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Ondřej Kopr

Category:

Logging

Target version:

Lapis (8.2.0)

Start date:

06/28/2018

Due date:

% Done:

90%

Estimated time:

Owner:

Description

Version 8.1.2
I have millions of logging events and a slow environment. I tried to delete logs by RemoveOldLogsTaskExecutor, but it was too slow (around 100 of events per second).

Could you please provide some faster delete of logging events, which deletes all events and doesn't have to retrieve it from the database first?
(Consulted with Zdeněk - the application should delete logs by some direct SQL query, not one by one in Java)

Actions

Copy link

Updated by Alena Peterová over 6 years ago

Description updated (diff)

Actions

Copy link

Updated by Ondřej Kopr over 6 years ago

Assignee changed from Radek Tomiška to Ondřej Kopr

Actions

Copy link

Updated by Ondřej Kopr over 6 years ago

Status changed from New to Needs feedback
Assignee changed from Ondřej Kopr to Alena Peterová
Target version set to Lapis (8.2.0)
% Done changed from 0 to 90

I update behavior for remove old logs. Now is removing much faster than before. I'm little bit fighting with creating test for this feature, because logback db appender doesn't support h2 connection.

commit: https://github.com/bcvsolutions/CzechIdMng/commit/88159c78dcbc6741b399f7ac0d9b2db673930490 (branch: okopr/1159-update-remove-logs)

In commit exists also flyway script before merge is necessary check last script in develop branch.

Please Alca could you made a review? Thank you :)

Actions

Copy link