org.turro.elephant.servlet.crawler.CrawlerOptions Class Reference

Inheritance diagram for org.turro.elephant.servlet.crawler.CrawlerOptions:

Collaboration diagram for org.turro.elephant.servlet.crawler.CrawlerOptions:

Public Member Functions
boolean	isActive ()
int	maxMinutes ()
int	maxRequests ()
boolean	isWhiteListed (String ip)
boolean	isBlackListed (String ip)
boolean	isBadRequest (String request)
boolean	isBadAgent (String agent)
boolean	isAllowedDomain (String domain)
void	whiteList (ActivityAction action)
void	blackList (ActivityAction action)
Consumer< ActivityAction >	onWhiteList ()
Consumer< ActivityAction >	onBlackList ()
String	toJson ()
String	toJson (Map< String, Object > properties)

Static Public Member Functions
static CrawlerOptions	instance ()

Static Public Attributes
static final transient String	CRAWLERS_RESPONSE = "/WEB-INF/elephant/activity/crawlers.html"

Detailed Description

Author

Lluis Turró Cutiller lluis.nosp@m.@tur.nosp@m.ro.or.nosp@m.g

Definition at line 40 of file CrawlerOptions.java.

Member Function Documentation

blackList()

void org.turro.elephant.servlet.crawler.CrawlerOptions.blackList

(

ActivityAction

action

)

Definition at line 106 of file CrawlerOptions.java.

                                               {
    CrawlerLists cl = loadLists();
    cl.getBlackList().add(action);
    saveLists(cl);
    setAllowedFrom(cl);
  }

Here is the call graph for this function:

instance()

static CrawlerOptions org.turro.elephant.servlet.crawler.CrawlerOptions.instance ( )

static

Definition at line 139 of file CrawlerOptions.java.

                                          {
    return load();
  }

Here is the caller graph for this function:

isActive()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isActive

(

)

Definition at line 58 of file CrawlerOptions.java.

                            {
    return active;
  }

isAllowedDomain()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isAllowedDomain

(

String

domain

)

Definition at line 93 of file CrawlerOptions.java.

                                                {
    return !Strings.isBlank(domain) && allowedDomains.stream().anyMatch(wd -> domain.endsWith(wd));
  }

isBadAgent()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isBadAgent

(

String

agent

)

Definition at line 88 of file CrawlerOptions.java.

                                          {
    return agent == null || badAgent.stream().anyMatch(br -> agent.matches(br));
  }

isBadRequest()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isBadRequest

(

String

request

)

Definition at line 83 of file CrawlerOptions.java.

                                              {
    return request == null || badRequest.stream().anyMatch(br -> request.matches(br));
  }

isBlackListed()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isBlackListed

(

String

ip

)

Definition at line 78 of file CrawlerOptions.java.

                                          {
    return allowedSet != null && allowedSet.isBlackListed(ip);
  }

Here is the call graph for this function:

isWhiteListed()

boolean org.turro.elephant.servlet.crawler.CrawlerOptions.isWhiteListed

(

String

ip

)

Definition at line 73 of file CrawlerOptions.java.

                                          {
    return allowedSet != null && allowedSet.isWhiteListed(ip);
  }

Here is the call graph for this function:

maxMinutes()

int org.turro.elephant.servlet.crawler.CrawlerOptions.maxMinutes

(

)

Definition at line 63 of file CrawlerOptions.java.

                          {
    return maxMinutes;
  }

maxRequests()

int org.turro.elephant.servlet.crawler.CrawlerOptions.maxRequests

(

)

Definition at line 68 of file CrawlerOptions.java.

                           {
    return maxRequests;
  }

onBlackList()

Consumer<ActivityAction> org.turro.elephant.servlet.crawler.CrawlerOptions.onBlackList

(

)

Definition at line 125 of file CrawlerOptions.java.

                                                {
    return (action) -> {
//      MailSenders.getPool()
//              .addAdministrators()
//              .send("Blacklisted", 
//                      Phrases.start("Blacklisted", action.getIp(), ":", action.getDomain())
//                              .line().add(action.getReason()).toString());
    };
  }

onWhiteList()

Consumer<ActivityAction> org.turro.elephant.servlet.crawler.CrawlerOptions.onWhiteList

(

)

Definition at line 114 of file CrawlerOptions.java.

                                                {
    return (action) -> {
//      MailSenders.getPool()
//              .addAdministrators()
//              .send("Whitelisted", 
//                      Phrases.start("Whitelisted", action.getIp(), ":", action.getDomain())
//                              .line().add(action.getReason()).toString());
    };
  }

toJson() [1/2]

String org.turro.elephant.servlet.crawler.CrawlerOptions.toJson

(

)

Definition at line 251 of file CrawlerOptions.java.

                         {
    return toJson(this);
  }

Here is the caller graph for this function:

toJson() [2/2]

String org.turro.elephant.servlet.crawler.CrawlerOptions.toJson

(

Map< String, Object >

properties

)

Definition at line 256 of file CrawlerOptions.java.

                                                       {
    return toJson(this, properties);
  }

Here is the call graph for this function:

whiteList()

void org.turro.elephant.servlet.crawler.CrawlerOptions.whiteList

(

ActivityAction

action

)

Definition at line 98 of file CrawlerOptions.java.

                                               {
    CrawlerLists cl = loadLists();
    cl.getWhiteList().add(action);
    saveLists(cl);
    setAllowedFrom(cl);
  }

Here is the call graph for this function:

Member Data Documentation

CRAWLERS_RESPONSE

final transient String org.turro.elephant.servlet.crawler.CrawlerOptions.CRAWLERS_RESPONSE = "/WEB-INF/elephant/activity/crawlers.html"

static

Definition at line 137 of file CrawlerOptions.java.

---

The documentation for this class was generated from the following file:

• CrawlerOptions.java