| 29 Oct 2005 - 13:41 | BlackListPlugin - _handleBanList( Action: read, IP: 71.141.119.124 ) | 29 Oct 2005 - 13:41 | BlackListPlugin - _handleEventLog( IP: 71.141.119.124, type: /path/to/bin/view, query: ) | 29 Oct 2005 - 13:41 | BlackListPlugin - initPlugin() score: 3 | 29 Oct 2005 - 13:41 | BlackListPlugin - initPlugin( TWiki.BlackListPlugin ) is OK, whiteList (127\.0\.0\.1), blackRE (203\.88\.152\.|203\.88\.155\.|219\.65\.75\.) | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebTopBar ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
Powered by <nop>TWiki
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/web-bg-small.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.BlackListPlugin ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> <nop>BlackListPlugin < TWiki < <nop>TWiki
Skip to topic | Skip to bottom
Powered by <nop>TWiki
You are here: [[Main.WebHome][TWiki]] > TWiki Web > BlackListPlugin r7 - 29 Oct 2005 - 07:57 - Main.PeterThoeny

Start of topic | Skip to actions
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - endRenderingHandler( TWiki.BlackListPlugin ) | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.BlackListPlugin ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> ---+ Black List Plugin This is a simple utility to keep black sheep away from a public TWiki site. The site can be protected against excessive page access (e.g. by bad robots), suspicious activities of users, such as multiple registrations or rapid topic updates indicating Wiki:WikiSpam, or saving text with wiki-spam. The Plugin monitors activities by IP address and uses three IP address lists to protect the TWiki site: * WHITELIST: Manually maintained list of users who should never get on the BANLIST * BLACKLIST: Manually maintained list of malicious users * BANLIST: Automatically updated list of users with suspicious activities On topic save, text is compared to a known list of spam patterns. If wiki-spam is identified, topic save is cancelled, an error message is shown, and the IP address is put on the BANLIST. Two wiki-spam lists are used: * Local SPAMLIST: Manually maintained list of spam patterns * Public wiki-spam list: Big list of wiki-spam patterns, retrieved from external web site Users on the BLACKLIST and BANLIST will have every page access delayed by one minute and will get an error message. To fight Wiki-spam, the Plugin can also add a =rel="nofollow"= parameter to external URLs. Search engines will not follow links that have this parameter, taking away the incentive to add spam to TWiki. ---++ Plugin Settings Plugin settings are stored as preferences variables. To reference a plugin setting write ==%<plugin>_<setting>%==, i.e. ==%INTERWIKIPLUGIN_SHORTDESCRIPTION%== __General settings:__ * One line description, is shown in the TWiki.TextFormattingRules topic: * Set SHORTDESCRIPTION = Utility to keep malicious users away from a public TWiki site * Debug plugin: (See output in =data/debug.txt=) * Set DEBUG = 0 * Log access of blacklist and spam list activities: (0 or 1) * Set LOGACCESS = 1 * Access restriction: * #Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup __WHITELIST, BLACKLIST and BANLIST settings:__ * WHITELIST: Comma delimited list of IP addresses; possible to use partial addresses ending in a dot * Set WHITELIST = 127.0.0.1 * BLACKLIST: Comma delimited list of IP addresses; possible to use partial addresses ending in a dot * Set BLACKLIST = 203.88.152., 203.88.155., 219.65.75. #BanList
* BANLIST: Automatically updated list of IP addresses based on BANLIST configuration * Action: IP address 203.88.152., 203.88.155., 219.65.75. * Current list: 203.88.152., 203.88.155., 219.65.75.
* BANLIST configuration, comma delimited list of: 1 points for registration 2 Points for each save and upload 3 Points for view raw 4 Points for other actions like view 5 Threshold to add to BANLIST 6 Measured over time (in seconds) * Set BANLISTCONFIG = 20, 5, 1, 20, 120, 300 * Your current score: 203.88.152., 203.88.155., 219.65.75. for IP address 71.141.119.124 * Message for users on BLACKLIST and BANLIST: * Set BLACKLISTMESSAGE = Your IP address 71.141.119.124 is black listed at the TWiki web site due to excessive access or suspicious activities. Please contact site administrator webmaster if you got on the list by mistake. __Wiki-spam filtering settings:__ * Filter wiki-spam on topic save based on SPAMLIST: (0 or 1) * Set FILTERWIKISPAM = 1 * Comma separated list of Web.Topics to exclude from wiki-spam filtering: * Set SPAMEXCLUDETOPICS = #SpamList
* Local SPAMLIST: Manually maintained list of spam patterns (NOTE: *Must be* TWiki.RegularExpression patterns) * Action: wiki-spam regex pattern http://.*? 203.88.152., 203.88.155., 219.65.75. * Current list: 203.88.152., 203.88.155., 219.65.75.
* Public wiki-spam list: Big list of wiki-spam patterns, retrieved from external web site (thanks to MoinMoin's [[http://moinmoin.wikiwikiweb.de/AntiSpamGlobalSolution][AntiSpamGlobalSolution]] wiki-spam list) * Set SPAMLISTURL = http://arch.thinkmo.de/cgi-bin/spam-merge * Cache refresh time (in minutes) for public wiki-merge pattern list: * Set SPAMLISTREFRESH = 60 * Cache refresh time (in minutes) for internal wiki-spam regular expression cache: * Set SPAMREGEXREFRESH = 10 * Message for users trying to save text with wiki-spam: * Set WIKISPAMMESSAGE = Wiki-spam detected, "%WIKISPAMWORD%" is a banned word and cannot be saved. Your IP address 71.141.119.124 is black listed at the TWiki web site due to suspicious activities. Please contact site administrator webmaster if you got on the list by mistake. __Nofollow link setting:__ * Add a =rel="nofollow"= parameter to external URLs. Use this is to fight Wiki-spam. Search engines will not follow the link if a URL has a nofollow parameter, such as =<a href="http://spammer.com/" rel="nofollow">=. Specify topic age in hours for which the nofollow parameter should appear (set it to a value that gives you enough time to remove spam); set it to -1 to add the nofollow parameter unconditionally to external URLs; or 0 to disable: (-1, 0, 1...N) * Set NOFOLLOWAGE = -1 ---++ Plugin Installation Instructions __Note:__ You do not need to install anything on the browser to use this plugin. The following instructions are for the administrator who installs the plugin on the server where TWiki is running. * Download the ZIP file from the Plugin web (see below) * Unzip ==BlackListPlugin.zip== in your twiki installation directory. Content: | *File:* | *Description:* | | ==data/TWiki/BlackListPlugin.txt== | Plugin topic | | ==data/TWiki/BlackListPlugin.txt,v== | Plugin topic repository | | ==lib/TWiki/Plugins/BlackListPlugin.pm== | Plugin Perl module | | ==pub/TWiki/BlackListPlugin/.htaccess== | Apache access control to protect pub dir | * Write protect this Plugin topics by removing the # hash sign from the ALLOWTOPICCHANGE setting * Make sure =pub/TWiki/BlackListPlugin/= is writable by the CGI user (typically =nobody=) * Dakar release only: Run the configure utility in your browser to enable the Plugin * Test if the installation was successful: 1 Using above form, add the IP address of one of your workstations to the BANLIST 1 Access TWiki from that workstation * if you look at a TWiki topic (with the view script) you should see the BLACKLISTMESSAGE (defined above) after a one minute timeout * else, you should get an 500 Internal Server Error for other scripts 1 On a different workstation, remove the IP address of the test workstation from the BANLIST ---++ Plugin Info | Plugin Author: | TWiki:Main/PeterThoeny | | Plugin Version: | 29 Oct 2005 | | Change History: |   | | 29 Oct 2005: | Added wiki-spam handling to prevent topic save with wiki-spam | | 27 Oct 2005: | For BANLIST, add/remove multiple IP addresses at once, contributed by TWiki:Main.MichaelDaum | | 22 Jan 2005: | Added NOFOLLOWAGE handling | | 19 Jan 2005: | Added score for "view raw" to address e-mail harvester issue | | 05 Apr 2004: | Fixed bug in event log (requiring update of earlier Plugin versions); doc updates | | 04 Apr 2004: | Added WHITELIST and BANLIST | | 21 Mar 2004: | Initial version | | CPAN Dependencies: | none | | Other Dependencies: | none | | Perl Version: | 5.005 | | License: | GPL ([[http://www.gnu.org/copyleft/gpl.html][GNU General Public License]]) | | TWiki:Plugins/Benchmark: | TWiki.GoodStyle 99%, TWiki.FormattedSearch 99%, BlackListPlugin 97% | | Plugin Home: | http://TWiki.org/cgi-bin/view/Plugins/BlackListPlugin | | Feedback: | http://TWiki.org/cgi-bin/view/Plugins/BlackListPluginDev | | Appraisal: | http://TWiki.org/cgi-bin/view/Plugins/BlackListPluginAppraisal | __Related Topics:__ TWiki.TWikiPreferences, TWiki.TWikiPlugins, [[http://directory.google.com/Top/Computers/Internet/Abuse/Spam/Blacklists/][Google blacklist directory]] -- TWiki:Main/PeterThoeny - 29 Oct 2005 <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - endRenderingHandler( TWiki.BlackListPlugin ) | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebBottomBar ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> This site is powered by the TWiki collaboration platformCopyright © 1999-2005 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/arrowright.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/searchtopic.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/flag-gray-small.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebLeftBarSearch ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
 
 
[[/path/to/bin/oops/TWiki/BlackListPlugin?template=oopschangelanguage][Change language Change language]]
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/home.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/person.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/group.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/index.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/searchtopic.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/changes.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/notify.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/statistics.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/wrench.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebHome ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
Searched: %SEARCHSTRING%
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebHome ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
Number of topics: %NTOPICS%
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebHome ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
Searched: %SEARCHSTRING%
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebHome ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
Number of topics: %NTOPICS%
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( NOWEB.NOTOPIC ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> /path/to/pub/TWiki/TWikiDocGraphics/web-bg.gif <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebLeftBarWebsList ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> * *Webs* *  Main *  Sandbox *  TWiki *  TestCases <<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.WebLeftBar ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>>
 
 
[[/path/to/bin/oops/TWiki/BlackListPlugin?template=oopschangelanguage][Change language Change language]]
--- * [[TWiki.WebHome][ home TWiki Web]] * [[Main.TWikiUsers][ person Users]] * [[Main.TWikiGroups][ group Groups]] * [[WebTopicList][ index Index]] * [[TWiki.WebSearch][ searchtopic Search]] * [[WebChanges][ changes Changes]] * [[WebNotify][ notify Notifications]] * [[WebStatistics][ statistics Statistics]] * [[WebPreferences][ wrench Preferences]] --- * User Reference * ATasteOfTWiki * TextFormattingRules * TWikiVariables * TWikiDocGraphics * TWikiSkinBrowser * InstalledPlugins --- * Admin Maintenance * AdminToolsCategory * InterWikis * ManagingWebs * TWikiSiteTools * TWikiAdminCookBook * TWikiPreferences * WebPreferences --- * *DocumentationCategories* * TWiki.AdminDocumentationCategory * TWiki.DeveloperDocumentationCategory * TWiki.UserDocumentationCategory --- * *ToolsCategories* * TWiki.AdminToolsCategory * TWiki.UserToolsCategory --- * *Webs* *  Main *  Sandbox *  TWiki *  TestCases
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - commonTagsHandler( TWiki.BlackListPlugin ) | 29 Oct 2005 - 13:41 | BlackListPlugin - >>>>>>>>>>>>>>>>>>>> #TopicEnd
Edit | Attach | Printable | Raw text | Backlinks: Web, All Webs  |  History: r7 < r6 < r5 < r4 < r3  | More topic actions
#PageBottom
This site is powered by the TWiki collaboration platformCopyright © 1999-2005 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
 
 
[[/path/to/bin/oops/TWiki/BlackListPlugin?template=oopschangelanguage][Change language Change language]]
--- * [[TWiki.WebHome][ home TWiki Web]] * [[Main.TWikiUsers][ person Users]] * [[Main.TWikiGroups][ group Groups]] * [[WebTopicList][ index Index]] * [[TWiki.WebSearch][ searchtopic Search]] * [[WebChanges][ changes Changes]] * [[WebNotify][ notify Notifications]] * [[WebStatistics][ statistics Statistics]] * [[WebPreferences][ wrench Preferences]] --- * User Reference * ATasteOfTWiki * TextFormattingRules * TWikiVariables * TWikiDocGraphics * TWikiSkinBrowser * InstalledPlugins --- * Admin Maintenance * AdminToolsCategory * InterWikis * ManagingWebs * TWikiSiteTools * TWikiAdminCookBook * TWikiPreferences * WebPreferences --- * *DocumentationCategories* * TWiki.AdminDocumentationCategory * TWiki.DeveloperDocumentationCategory * TWiki.UserDocumentationCategory --- * *ToolsCategories* * TWiki.AdminToolsCategory * TWiki.UserToolsCategory --- * *Webs* *  Main *  Sandbox *  TWiki *  TestCases
<<<<<<<<<<<<<<<<<<<< | 29 Oct 2005 - 13:41 | BlackListPlugin - endRenderingHandler( TWiki.BlackListPlugin )