Data Clean Up

The Data Clean Up Service Task applies actions to results that were not displayed in the Agent UI and therefore were not labeled with an action on the Agent.

When viewing results in the Agent and you select a location and perform an action on all results in that location, such as shred, quarantine, Restrict Access, recycle or encrypt, the Agent performs the action on the entire location, but only the displayed matches are labeled with that action. Any results that are not displayed do not have that action label applied. So, if you select shred, the entire is shredded, but only the matches that were displayed have a label of shredded when viewing the results in the Console, even though the Console displays all of the matches. The Data Clean Up service task applies that action label to the rest of the results in that location.

For example, if you had run a search and a particular location had 20 matches, 10 CCN and 10 SSN, after the results have been imported into the Console, you are able to view all 20 matches on the Console. If you then ran another search on that Agent, but this time searched only for CCN and then shredded the location, the entire file is gone but only the 10 CCN results are labeled with an action of shredded. This time when you view the results in the Console it shows an action of shredded for the 10 CCN results, but not for the 10 SSN results since they were not displayed in the Agent at the time you performed the shred. Running the Data Clean Up service task applies that action label to the 10 SSN results that were in that location.

Another example, if you have the setting "Limit display when the following number of Maximum Matches is reached" set to 99, and you search a file which has 120 unique credit card numbers in it, the Agent displays only 99 matches from that location, but all 120 matches are sent to the Console. If you shred that location from within the Agent UI, it shreds the entire file, so all 120 matches are shredded, but only the 99 which were displayed have the shred label applied to them, leaving the 21 which were not displayed without the shred label. When the results have been imported to the Console and you view that location in the Console, the 99 matches which were visible show the shred action, while the remaining 21 have an action of 'none'. Running the Data Clean Up task applies the shred label to those matches which were not displayed in the Agent but have indeed been shredded.

The Data Clean Up Service Task has the following options:

Field Description
Information This text field is used to provide a description of the purpose of the Data Clean Up task being created and is only present to help users manage their tasks.
Location This option only displays if you have chosen to replicate your database prior to installation of the Console, but is disabled for this service task.
Resume when no other tasks are pending When selected, the "Repeat task every:" is ignored when no tasks are pending and the task starts immediately.
Maximum task run time

Specify the amount of time that the service task has to complete. For example, if you set the Maximum task run time to 5 minutes, after 5 minutes has elapsed from the time the service task first executes, the service job stops and its status shows as Aborted. The default setting is indefinitely. The following options are available:

  • Indefinitely - The task runs until completion.
  • Minutes - Set the number of minutes the service task has to complete. If the service task does not complete within the allotted time it aborts.
  • Hours - Set the number of hours the service task has to complete. If the service task does not complete within the allotted time it aborts.
  • Days - Select the number of days the service task has to complete. If the service task does not complete within the allotted time it aborts.

Note: The Data Clean Up task can, depending upon the amount of data involved, be a time consuming task. If you see the status of this task is failing, it may be necessary to increase the Command Timeout value in the CAT.