Shredder - Revision history

Robl: /* Daily cron script to purge deleted tickets and unlinked users */

2024-11-09T12:15:27Z

Daily cron script to purge deleted tickets and unlinked users

← Older revision		Revision as of 08:15, 9 November 2024
Line 54:		Line 54:
	"Users=not_member_of,Staff;member_of,unprivileged;no_tickets,1;status,any;replace_relations,Nobody;limit,50"		"Users=not_member_of,Staff;member_of,unprivileged;no_tickets,1;status,any;replace_relations,Nobody;limit,50"

	You will need to modify this script/query for your use. The limits I have ~~set~~ work fine in our installation, but you may need to reduce (especially for the first run where it would delete lots of tickets or users.)		You will need to modify this script/query for your use.

			* The limits I have used work fine in our installation, but you may need to reduce (especially for the first run where it would delete lots of tickets or users.)
			* For testing purposes, remove the --force option. As it's designed to be run from cron, it does not prompt before deleting.

	<source lang="bash">		<source lang="bash">
Line 65:		Line 68:
	# Backup .sql files are retained.		# Backup .sql files are retained.

			# Set as appropriate:
	RT_SHREDDER="/usr/local/sbin/rt-shredder"		RT_SHREDDER="/usr/local/sbin/rt-shredder"
	BACKUPDIR="/srv/rt5/var/rt-shredder"		BACKUPDIR="/srv/rt5/var/rt-shredder"

			# Needs bzip or similar installed:
			BZIP="/usr/bin/bzip2"


	# Check things exist:		# Check things exist:
Line 140:		Line 148:
	# Bzip any remaining .sql files:		# Bzip any remaining .sql files:
	for f in ${BACKUPDIR}/*.sql ; do		for f in ${BACKUPDIR}/*.sql ; do
	[ -e "$f" ] && ~~/usr/bin/bzip2~~ -q ${BACKUPDIR}/*.sql		[ -e "$f" ] && ${BZIP} -q ${BACKUPDIR}/*.sql
	break		break
	done		done

Robl: /* Daily cron script to purge deleted tickets and unlinked users */

2024-11-09T12:09:09Z

Daily cron script to purge deleted tickets and unlinked users

← Older revision		Revision as of 08:09, 9 November 2024
Line 54:		Line 54:
	"Users=not_member_of,Staff;member_of,unprivileged;no_tickets,1;status,any;replace_relations,Nobody;limit,50"		"Users=not_member_of,Staff;member_of,unprivileged;no_tickets,1;status,any;replace_relations,Nobody;limit,50"

	You will need to modify this script/query for your use:-		You will need to modify this script/query for your use. The limits I have set work fine in our installation, but you may need to reduce (especially for the first run where it would delete lots of tickets or users.)

	<source lang="bash">		<source lang="bash">

Robl: updates. add example cron script.

2024-11-09T12:01:56Z

updates. add example cron script.

Show changes

Phanousk: /* Speed up shredding process */

2024-02-09T10:33:49Z

Speed up shredding process

← Older revision		Revision as of 06:33, 9 February 2024
Line 106:		Line 106:
	CREATE INDEX SHREDDER_ATTACHMENTS1 ON Attachments(Creator);		CREATE INDEX SHREDDER_ATTACHMENTS1 ON Attachments(Creator);

	For newer RT versions ([https://docs.bestpractical.com/rt/4.2.16/RT/Shredder.html#Database-Indexes 4.4.6 and also 5.0.4]) you may need more indexes:		For newer RT versions ([https://docs.bestpractical.com/rt/4.4.6/RT/Shredder.html#Database-Indexes 4.4.6] and also [https://docs.bestpractical.com/rt/4.4.6/RT/Shredder.html#Database-Indexes 5.0.4]) you may need more indexes:
	CREATE INDEX SHREDDER_LINKS1 ON Links(Target);		CREATE INDEX SHREDDER_LINKS1 ON Links(Target);
	CREATE INDEX SHREDDER_ACL1 ON ACL(ObjectType, ObjectId);		CREATE INDEX SHREDDER_ACL1 ON ACL(ObjectType, ObjectId);

Phanousk: /* Speed up shredding process */

2023-08-17T13:11:23Z

Speed up shredding process

← Older revision		Revision as of 09:11, 17 August 2023
Line 95:		Line 95:

	== Speed up shredding process ==		== Speed up shredding process ==
	You need to set up the database indexes according to [https://docs.bestpractical.com/rt/4.2.16/RT/Shredder.html#Database-Indexes Shredder documentation]:		You need to set up the database indexes according to [https://docs.bestpractical.com/rt/4.2.16/RT/Shredder.html#Database-Indexes Shredder documentation (RT 4.2.16)]:
	CREATE INDEX SHREDDER_CGM1 ON CachedGroupMembers(MemberId, GroupId, Disabled);		CREATE INDEX SHREDDER_CGM1 ON CachedGroupMembers(MemberId, GroupId, Disabled);
	CREATE INDEX SHREDDER_CGM2 ON CachedGroupMembers(ImmediateParentId,MemberId);		CREATE INDEX SHREDDER_CGM2 ON CachedGroupMembers(ImmediateParentId,MemberId);
Line 105:		Line 105:
	CREATE INDEX SHREDDER_TXN4 ON Transactions(Type, NewValue);		CREATE INDEX SHREDDER_TXN4 ON Transactions(Type, NewValue);
	CREATE INDEX SHREDDER_ATTACHMENTS1 ON Attachments(Creator);		CREATE INDEX SHREDDER_ATTACHMENTS1 ON Attachments(Creator);

			For newer RT versions ([https://docs.bestpractical.com/rt/4.2.16/RT/Shredder.html#Database-Indexes 4.4.6 and also 5.0.4]) you may need more indexes:
			CREATE INDEX SHREDDER_LINKS1 ON Links(Target);
			CREATE INDEX SHREDDER_ACL1 ON ACL(ObjectType, ObjectId);
			CREATE INDEX SHREDDER_OCFV1 ON ObjectCustomFieldValues(ObjectType, ObjectId);

	== Shredder for RT 3.6 and older ==		== Shredder for RT 3.6 and older ==

Phanousk at 07:07, 28 July 2019

2019-07-28T07:07:40Z

← Older revision		Revision as of 03:07, 28 July 2019
Line 93:		Line 93:

	Afterward, you will probably want to do the "Shred Users with no Tickets" run as described above as well.		Afterward, you will probably want to do the "Shred Users with no Tickets" run as described above as well.

			== Speed up shredding process ==
			You need to set up the database indexes according to [https://docs.bestpractical.com/rt/4.2.16/RT/Shredder.html#Database-Indexes Shredder documentation]:
			CREATE INDEX SHREDDER_CGM1 ON CachedGroupMembers(MemberId, GroupId, Disabled);
			CREATE INDEX SHREDDER_CGM2 ON CachedGroupMembers(ImmediateParentId,MemberId);
			CREATE INDEX SHREDDER_CGM3 on CachedGroupMembers (Via, Id);
			CREATE UNIQUE INDEX SHREDDER_GM1 ON GroupMembers(MemberId, GroupId);
			CREATE INDEX SHREDDER_TXN1 ON Transactions(ReferenceType, OldReference);
			CREATE INDEX SHREDDER_TXN2 ON Transactions(ReferenceType, NewReference);
			CREATE INDEX SHREDDER_TXN3 ON Transactions(Type, OldValue);
			CREATE INDEX SHREDDER_TXN4 ON Transactions(Type, NewValue);
			CREATE INDEX SHREDDER_ATTACHMENTS1 ON Attachments(Creator);

	== Shredder for RT 3.6 and older ==		== Shredder for RT 3.6 and older ==

Phanousk: /* With shredder and shell script */

2019-02-06T14:35:18Z

With shredder and shell script

← Older revision		Revision as of 10:35, 6 February 2019
Line 56:		Line 56:
	Bourne shell syntax is shown below:		Bourne shell syntax is shown below:

	<source lang="bash"> cd /tmp		<source lang="bash"><pre>
	while :		cd /tmp
	do		while :
	date		do
	SHREDDED=`rt-shredder --plugin "Tickets=query,id > 0;limit,100" --force --sqldump foo.sql 2>&1 \| grep RT::Ticket \| wc -l`		date
	echo "Shredded roughly $SHREDDED tickets."		SHREDDED=`rt-shredder --plugin "Tickets=query,id > 0;limit,100" --force --sqldump foo.sql 2>&1 \| grep RT::Ticket \| wc -l`
	sleep 3 # let the system get a breath		echo "Shredded roughly $SHREDDED tickets."
	rm -f foo.sql # we don't care about restoring what we shredded in this case		sleep 3 # let the system get a breath
	if [ $SHREDDED -eq 0 ]; then		rm -f foo.sql # we don't care about restoring what we shredded in this case
	break		if [ $SHREDDED -eq 0 ]; then
	fi		break
	done		fi
	</source>		done
			</pre></source>

	=== With rt-validator ===		=== With rt-validator ===

Phanousk: /* With shredder and shell script */

2019-02-06T14:27:37Z

With shredder and shell script

← Older revision		Revision as of 10:27, 6 February 2019
Line 56:		Line 56:
	Bourne shell syntax is shown below:		Bourne shell syntax is shown below:

	cd /tmp		<source lang="bash"> cd /tmp
	while :		while :
	do		do
Line 68:		Line 68:
	fi		fi
	done		done
			</source>

	=== With rt-validator ===		=== With rt-validator ===

Phanousk: /* Examples */

2018-01-22T10:41:25Z

Examples

← Older revision		Revision as of 06:41, 22 January 2018
Line 29:		Line 29:

	== Examples ==		== Examples ==

	Examples presented with shell commands, but the same can be performed in the [[#WebUI \|WebUI]].		Examples presented with shell commands, but the same can be performed in the [[#WebUI \|WebUI]].

	=== Shred Deleted Tickets by Status and Age ===		=== Shred Deleted Tickets by Status and Age ===

	You can run the following command by hand and see the results.		You can run the following command by hand and see the results.

	rt-shredder --plugin "Tickets=query,Status = 'Deleted' AND LastUpdated < '30 days ago';limit,100" --sqldump /{somepath}/shredder-restore-tickets.sql		rt-shredder --plugin "Tickets=query,Status = 'Deleted' AND LastUpdated < '30 days ago';limit,100" --sqldump /{somepath}/shredder-restore-tickets.sql

	=== Shred Users with no Tickets ===		=== Shred Users with no Tickets ===

	Users with no tickets are users who have had their tickets deleted -- spam senders, or users whose tickets have been moved to another user.		Users with no tickets are users who have had their tickets deleted -- spam senders, or users whose tickets have been moved to another user.
			rt-shredder --plugin "Users=no_tickets,1;status,any;replace_relations,Nobody;limit,5" --sqldump /{somepath}/shredder-restore-users.sql --force

	rt-shredder --plugin "~~Users~~=~~no_tickets~~,1;~~status~~,~~any~~;~~replace_relations~~,~~Nobody;limit,5~~" ~~--sqldump /{somepath}/shredder-restore-users.sql --force~~		=== Shred multiple Scrips ===
			/opt/rt4/sbin/rt-shredder --plugin "Objects=Scrip,26;Scrip,28;Scrip,53"

	== Shredding many tickets ==		== Shredding many tickets ==

Admin: 9 revisions imported

2016-04-06T20:37:45Z

9 revisions imported

← Older revision		Revision as of 16:37, 6 April 2016
(No difference)