# $Id: TODO 4730 2012-01-14 21:16:34Z pro $ $URL: svn://svn.setun.net/search/trunk/TODO $

Primary:

toscan->db, banned->db, dc dont dl filelist when no need, parse .dclst, finish new style

dc and ftp? host dupes

/stable dcc bot 

/ftp detect codepage  -  needs more testing

web help

other:


grant.sql -> script

sort by dir AND file for m3u

doc for res keepers  (film/llslslslls ... xxx ... 

http -> https link bug ?

duplicate http:// on observe

internal shedule

scan local dir ( c:\ , / )

HTML: accesskey="f" alt= title= ANYWHERE

/', ($param{'size_mode'} eq 'e' ? 'selected="selected"' : '') , ' on WhWhWh

where extended

link to show size of dir when size == 0

popular sta:
2. all search param (not empty abc) (pop PAGES)

more sorting

describe .bbs .ion .m3u in html to help

load data from file

skip .pptp. ppp adsl pppoe dialup and ..... hosts

stats

?user css in rss

banned!!

http://dev.mysql.com/doc/mysql/en/insert-speed.html

ls-lR.gz

http://www.w3.org/TR/REC-html40/interact/forms.html#adef-accesskey

hilight .
http://proisk.ru/?q=&host=%2Asp.%2A&path=EMPTY&order=scan&order_rev=on&show_page=1

upload in proc

slideshow

?getfile cache & time check

alter - update table struct 

getcounter -> sql

host:ip primary

index order optimize

?? hotcopy by table prefix

smaaaal screen

counry code in ranges?

http://proisk.ru/?n=1&q=gggg+kkkk&what_help=mpg%7Cmpeg%7Cm2v%7Cavi%7Casf%7Cwmv%7Cogm%7Cnsv%7Cvob%7Crm%7Cmov%7Cmkv%7Cmp4%7Cbik%7Csmk%7Cfli%7Cdivx%7C3gp%7Cdat&ext=mpg%7Cmpeg%7Cm2v%7Cavi%7Casf%7Cwmv%7Cogm%7Cnsv%7Cvob%7Crm%7Cmov%7Cmkv%7Cmp4%7Cbik%7Csmk%7Cfli%7Cdivx%7C3gp%7Cdat&order=size&order_rev=on

==after svn:
sort reverse TOSCAN by order

disable slow NOT with ORDER queryes

disable slow COUNT

qstat with q=

automatic scan ONLY one directory on server

perl -w -T

help.js

web: check_int in form sizes

toscan generate in ls-lR mode

purge nores hosts and resources

url_join url_split everywhere

slow queryes -> table config
and disable web elements for it

share login:pass define

only known pinger process

tarnowhub.pl

resource comments?
resource desc

encoding  ftp://194.154.87.216

/perl crawler.pl file://wk2 --sql_debug --force

remove default [ftp] user/pass/port (ftp: anonymous: :21) on add

pinger of file://name-of-comp

add user host port configurable rows

like explorer navigation with |-[+]-folder



convert some config booleans to 0 by default,
remove (comment) all config{..}=0 

ftp: ls-lR work with toscan

user-pass-port into host fix

proc: ping resources

better online time & pinger control

fix resource dl counter nulling on update

rotate flush

sub uniout - parse parametrs to func

dl counter - save and use last client IP  to skip dupes

TOTAL OPTIMIZATION! less cpu!

range fine tuning

no_do_search

ping order: ping RED res AFTER green for speed

scan ONLY dead hosts/ranges

show images ->>> .js

DBD::mysql::st execute failed: Query execution was interrupted at /usr/home/www/proisk.ru/search/web/lib/misc.pl line 309.
DBD::mysql::st fetchrow_hashref failed: fetch() without execute() at /home/www/proisk.ru/html/index.cgi line 371.

: 0	EMPTY/  	  

one next page for crawlers

-n to nmap to increase speed

!! INSERT ... ON DUPLICATE KEY UPDATE 
http://dev.mysql.com/doc/refman/5.1/en/insert-on-duplicate.html
in wordstat ip protection
(added in MySQL 4.1.0)


Ajax 8)

mrtg out - old mysql bug

test innodb with foregin keys without fulltext

mysql4
2006/03/01-01:16:48 230 SQLDEBUG: CREATE TABLE IF NOT EXISTS filebase (`prot` VARCHAR (16)  NOT NULL ,`host` VARCHAR (64)  NOT NULL ,`path` VARCHAR (200)  NOT NULL ,`name` VARCHAR (200)  NOT NULL ,`ext` VARCHAR (64)  NOT NULL ,`size` BIGINT  UNSIGNED NOT NULL  DEFAULT 0 ,`time` INT  UNSIGNED NOT NULL  DEFAULT 0 ,`desc` VARCHAR (200)  NOT NULL ,`scan` INT  UNSIGNED NOT NULL  DEFAULT 0 ,`dl` INT  UNSIGNED NOT NULL  DEFAULT 0 ,PRIMARY KEY (`prot`,`host`,`path`,`name`,`ext`),INDEX proti (`prot`(3)),INDEX hosti (`host`(16)),INDEX pathi (`path`(128)),INDEX namei (`name`(32)),INDEX exti (`ext`(8)),INDEX sizei (`size`),INDEX timei (`time`),INDEX scani (`scan`),INDEX dli (`dl`),FULLTEXT fulltexti (`path`,`name`,`ext`,`desc`)) ENGINE = MYISAM ;
DBD::mysql::db do failed: Specified key was too long. Max key length is 500 at lib/misc.pl line 291.
2006/03/01-01:16:48 SQL: error[1071,Specified key was too long. Max key length is 500]

crawler : ?dchub://hub/user  dchub://hub/

all file parametrs via uniget


BANNED TABLE!

morphology http://www.aot.ru/

filter query qith redirect (porno ...)

Win32::Console

show hosts with 0 files in web

?debug log to file web 

treads

grab first words ftom html

proc sheduler

sql: between 
expr BETWEEN min AND max 

area selecting [distributed cluster]

ftp: lost root ?

web: reset link ?? reset what?

remove $config{'w3_org_valid'}

remove all unused from confdef, comment = 0;

js: autoresize fields prot host pa......

better names for web params

log: scan finished (stat, reason)


?file://host/path -> web: file://host/path//name

http://www.w3.org/WAI/WCAG1AA-Conformance

compiled? css (all -> one), insert into <head> (after mod_perl)

mod_perl : load once static, config.

rfc822_date_time : TZ -> config or auto

atom feed

.pls playlist reading
print "#EXTM3U\n";
while (<>) {
#for (@pls) {
#  while(<$_>) {
  chomp;
  ($num, $file) = ($1, $2) if m/^file(\d+)=(.+)/i;
  ($title) = $1 if  m/^title\d+=(.+)/i;
  $title =~ s/D I G I T A L L Y - I M P O R T E D - //i,
  print("#EXTINF:-1,$title [$num]\n$file\n"),
   $file = '', $title = ''
   if $file and $title;
#  }
}



multilevel log, more logging (ftp connect, disconnect, reasons)

[22:38:31] PASS (hidden)
[22:38:31] 230 User logged in, proceed.
[22:38:31] SYST
[22:38:31] 215 UNIX Type: L8
[22:38:31] FEAT
[22:38:31] 211-Extension supported
[22:38:31]  CLNT
[22:38:31]  MDTM
[22:38:31]  MDTM YYYYMMDDHHMMSS[+-TZ];filename
[22:38:31]  SIZE
[22:38:31]  SITE PSWD;EXEC;SET;INDEX;ZONE;CHMOD;MSG
[22:38:31]  REST STREAM
[22:38:31]  XCRC filename;start;end
[22:38:31] 211 End
[22:38:31] Detected Server Software: Serv-U 4.x
[22:38:31] CLNT SmartFTP 2.0.996
[22:38:31] 200 Noted.
[22:38:31] PWD
[22:38:31] 257 "/" is current directory.

on page audio&video player, image view - button like (>) -> popup js, ...

web form: nameid

debug with recurse caller 

dont save ftp stat if scan interrupted

fix ie css

mod_perl tolal optimization:
?remove any $param from confi*.pl
 place BEGIN {}, END {}
memory usage tests 
sql_reconnect control and tests
clear config or mode clear values?  or make subs with every call configs


open() or print "error $!";

dcbot: close and reuse listen port

dc: primary by user


  ,      utf_trans  ,    ,     , ...  , 

dc: update res size from myinfo
    write sum(size) to desc of hub

/handler on filter 

sql create/update soft by every row


collect hubs from chat, welcome, forcemove

dcbot getting problem: StrongDC RC10, dctc

recource lock table ?

filter set (name &ext & size..)

 - magnet:?xt=urn:tree:tiger:Y5K5ODD4GU2LUFS6JX2S6KISPNZPGFJVDB57FVA&xl=829474816&dn=13-%EB%E5%F2%ED%FF%FF.avi
 - magnet:?xt=urn:tree:tiger:Y5K5ODD4GU2LUFS6JX2S6KISPNZPGFJVDB57FVA&xl=829474816&dn=13-.avi
   tiger.       ,    dn=...

-     UTF (  )

last & top downloads by magnet:

cache open logfiles

compare optimize vs repair

     
  -  

   Strong    2 : 
1.     
2.       

User PROSearch - Too small filelist - 0 B for the specified share of 10,00 GiB

modules versions

/test dir with various files , sybmols, descs, codepages

http://wikitest.freebsd.org/MySQL

http://perldoc.perl.org/utf8.html

http://search.cpan.org/src/RUDENKO/Lingua-DetectCyrillic-0.02/docs/ru/DetectCyrillic.htm

url encode stored dc filenames

$config{'locale'}

2006/06/21-09:20:09 [87065] info (52) UNKNOWN PEERCMD:[welcome]{Get} : please ad
d $dc->{'parse'}{'welcome'} = sub { ... };

utf fix uncnown symbols

    -    &show_page=nnn,  nnn -  ,     - , ,  ,   .
http://somehost/search/?count_f=on&q=%EC%F8%E2%F3%F9&show_page=1322&view=xml

cache m3u, bbs by date 

cp_auto tests with big text word-by-word

pda, textbrowser mode

rsync --list-only scan

dchub download .m3u, .bbs

symlink handling

 xml: stats

ALL SQL SELECT top query maker

file range: generator like $1-100$

cygwin

dcbot: welcome to desc

examples

       (     ,     -)

hconfig in processor{desc}, dcbot

html debug in div

js:auto my_getbyid

dclist:
      
      0.3 

                     web pinging dchub://dc.crossnet.ru/any.key
[4832] dbg ping: ext key prot dchub host dc.crossnet.ru/any

loong cookies

js: hide menus on click, show only one menu

web:   

ff bug: ftp://synclub:synclub@83.222.14.54/ambient/ as ftp://synclub/ambient/
http://proisk.ru/?q=Ildjarn&on_page=50&ext=mp3%7Cmp2%7Cmp1%7Cm4a%7Cnsa%7Cogg%7Cwav%7Caif%7Caiff%7Cwma%7Cra%7Cflac%7Clpac%7Cmac%7Cape%7Cm4a%7Caac&order=host

dcbot: ip:port collect, web: port ping;

js autohide menu, timeouts

web: size=dir = size=0

web: adjust: always show advanced

web: config: mode: recurse hash copy

    8)
    ,            
...   AJAX?

multi db search (mixed, ..)

utf: web out_bold ru BUG

graphs with rrdtool


        ?     

   ftp    , ,  -    



2006/07/29-03:57:43 [58326] info Started with [ ftp://192.168.32.2 --force=1 ] version: 0.15.18
2006/07/29-03:57:43 [58326] dbg Starting scan ftp://192.168.32.2
2006/07/29-03:57:43 [58326] ftp FTP: connected (1/50) to ftp://192.168.32.2 pasv=; [ego X2 WS_FTP Server 5.0.3 (1127946757)
Hello
ego X2 WS_FTP Server 5.0.3 (1127946757)]
2006/07/29-03:57:43 [58326] ftp Trying recurse mode
2006/07/29-03:57:43 [58326] dbg Cannot change to /
2006/07/29-03:57:44 [58326] info Finished [ ftp://192.168.32.2 --force=1 ] [ 1.70s ]

 :

>ftp 192.168.32.2
  192.168.32.2.
220-ego X2 WS_FTP Server 5.0.3 (56365694)
220-Hello
220 ego X2 WS_FTP Server 5.0.3 (56365694)
 (192.168.32.2:(none)):

   .        ,   
ftp> cd /
550 /: folder not found

web: pre & post  part run other parts with num of skips

vectors ops in dupe server detect

web: desc: m3u: show time in hh:mm:ss

2006/08/24-13:59:47 [2148] dc Get filelist from [T++L+L_-T-_-L+L]
2006/08/24-13:59:48 [2148] info [71] Incoming client 10.20.117.79
2006/08/24-13:59:48 [2148] info [71] peer is [ T++L+L_-T-_-L+L ]

detect repair error table 
SQL: error[1194,Table 'resource' is marked as crashed and should be repaired]
                       ^^^^^^^^
message `empty table` - bad


  ,  $config{'host_by_name_norm'}       
   $config{'host_by_name_norm_force'} = 1; ,          ,         
  ,      ,        -    ,      

stipid clock bot:
2006/08/27-02:45:02 [6064] dbg looking at 172.16.32.109/[02.41.55]  filelist:
2006/08/27-02:45:09 [6064] dc Get filelist from [[02.41.55]]
2006/08/27-02:45:14 [6064] dbg looking at 172.16.32.109/[02.41.56]  filelist:
2006/08/27-02:45:22 [6064] dc Get filelist from [[02.41.56]]
2006/08/27-02:45:24 [6064] dbg looking at 172.16.32.109/[02.41.57]  filelist:
2006/08/27-02:45:32 [6064] dc Get filelist from [[02.41.57]]

newstat (xml? get)
	total	online:
ipscan	xy	
iplive	xy	x
ipres	xy	x
bytes	xy	xy
files	xy	xy
dirs	xy	xy
--------------
goto's	xy
hits	xy	xy xy

queryes:
q=ftp://zzzz.zz/zz  -> prot=ftp host=zzzzz.zz ....

check params exist

dc hub stats (total/online users/gbs/files/dirs), hublist output

fake filelist sender: calc size from sharesize, send filelength, 
 send BZ, random ? or 0000

base optimization:
 skip unknown file types
 skip small files 


fps <0s

web: js: autocomplete :shortcuts

ipdig: (prot://)?0.0.0.0(/\d+)?  or  prot://[\w\._]+

kidding: svn:// scan 8)
        
web: css all sizes in em

2006/09/11-23:52:43 [2732] dbg Starting scan http://80.240.210.66
Parsing of undecoded UTF-8 will give garbage when decoding entities at C:/usr/site/lib/LWP/Protocol.pm line 114.

test:
allowscan period for ranges, make for dchub

user options: 
link divide, 
size in bytes/MGTbytes, 
date in days/absolute
?lang codepage mode

http recursve crawler with ipdig

css: user defined

dchub user-share graph 

 SQL: error[5,Out of memory (Needed 1338896 bytes)]

http links dig 

web: tips

stat: by prot (ftp, dchub) - files, bytes, hosts
 
parse MyList.DcLst

dcdl segmented, reconnection, 

parts:  _ x

test new toscan, test with old files

adjust: online m3u

remove $sparam
all @{ $config{'user_param'} }, @{ $config{'user_param_hidden'} } -> cookies

test: cut ^\{.*?\}\s*\[.*?\]\s*  from dc desc

dc minimum recv()

sql: where: local and global 'not'

/2006/10/13-23:27:07 [6531] err SQL: error[2002,Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2)] on executing {Connection}
/2006/10/13-23:27:17 [6531] info SQL:sleep 10 and trying to reconnect
/2006/10/13-23:27:27 [6531] err SQL: Error (re)connecting [,] 1 times, setting crawler_dbi=0

ie

mode=pda

to config selectors:
 $config{'sql'}{$config{'sql_driver'}}{'config'}{$_}

style: config or up

sub {my $oneparam => local $_

stat: averages files bytes dirs

js: ie panel fix

/check all globals, {closed vars}

hublist hub desc

mod_perl remove ParseHeaders

do config  - collect errors

HandleError

web: count DB time 

timer: init start stop get

????? in filenames

pwd configurable check, autodisable with /d:/ftp/...

sql->object module
 sqllite
 firebird     30 ;
 postgres

local $_ %_ everywhere

http cp autodetect : test

 , ttl   ?                       
nmap -D 'rnd_ips 10',me --ttl ${RANDOM%30+30} host.to.scan

http://forge.mysql.com/wiki/Top10SQLPerformanceTips

web: sql: multi join

arc filters

test:
/delete old files after scan res
check scanned files? before
purge_res

/2006/12/08-20:42:52 [72560] err SQL: error[1100,Table 'filebase' was not locked with LOCK TABLES] on executing {REPLACE LOW_PRIORITY INTO filebase (`pro

.js: naming: obj id

MyINFO $ALL zzz [1][L:1024KB]:(<ApexDC++ V:0.3.0,M:A,H:2/1/0,S:3,L:1024>$ $100$zzz@gmail.com$163391711690$
                ^^^^^^^^^^^^^    
reset current res scan+update time when closing crawler

finish new table config


mysqlcheck 

sql: not -> !

mode: ge>= e= g>

2006/12/27-14:10:59 [4860] err SQL: error[1406,Data too long for column 'desc' at row 1] on executing {REPLACE LOW_PRIORITY INTO filebase (`prot`,`host`,`dcuser`,`path`,`name`,`ext`,`tiger`,`size`,`time`,`desc`,`scan`,`dl`) VALUES
('dchub','dcpp.migtel.ru','AlexT','','','','','0','1167217064','[L:3500KB]-http://rs.migtel.ru','0','0');}

test: dc sharesize - parse 10m

[202s] 16    -  [204s] counter-strice [384s] Prodigy - Voodoo People [201s] AE47 - Ae?, yoi Iaeenoai ft. LeeMan
^^^^^^                          ^^^^^^                ^^^^^^    

18	ftp://147.169-224-87.telenet.ru/Orthodoxy/ 2/९  㠭 䮭᪨ - ᠭ/PL/239.MP3    - +	[^:v] ३ ᪠ alt	935 KB	1Y	[78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239 [78s] 239	  26d
19	ftp://147.169-224-87.telenet.ru/Orthodoxy/ 2/९  㠭 䮭᪨ - ᠭ/PL/361.MP3    - +	[^:v] ३ ᪠ alt	925 KB	3Y	[78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361 [78s] 361

.toscan expiry

/replace-> insert .. on dup... update  .. values
test speed

js embed


all/file/dir -> size>0 <0 *

exts: http://www.fileinfo.net/common.php

long? path cutting 
name.ext -> alt=full

allow_x = 1 => no_x=0 => empty

simple - onedir link cutting

player: dont resize table - opera bug 

player: browser notes 

bug ftp path in res

remove? filestat table

test oneline with dcuser

use_dc_only optimize

mod: this file showed n times in result

clear form

 test use_dc !!!

long link cut /.../

what? - directory

webadd: if no prot scan ip for 21,80,139,...
	error if port unreachable

jshttp internal check form-disable

player -> detach in new win

web error: q=*win*xp*pro*rus*

web: get_param_str -> get_param_hash, del $work{'sparam'} $work{'uparam'}

no-ip:+ http://www.dyndns.com/services/dns/dyndns/domains.html

find test: href=>'#'

reset? clear?

delayed key_write DELAY_KEY_WRITE 

popup help menus -> via presets

!:preset

presets: host -> ip

$processor{'out'}{'hash'}

Content-Disposition:attachment  ENCODINGS
http://david-m.livejournal.com/793408.html
http://xpoint.ru/forums/internet/standards/thread/36701.xhtml


align="justify"

find eng:   (.+)  

doc: proxy debugs

sql retry+parse

one dir mode : link with fullname

https://addons.mozilla.org/ru/firefox/addon/446?id=446&application=firefox

show mysql conn ID

test purge


lib2:


crawler::
/install
/config table
index disa,ena
in upgrade: $config{'sql_base'}
  local $config{'sql_error_tries'} = 0;
  local $config{'sql_error_sleep'} = 0;
repair
$processor{'out'}{'mysql'}
mrtg retries
/count files dirs bytes
/index:: init: retry sleep etc
/      pinger: --//--
 database select in :
   in for my $stat (qw(file word query)) {  $out{'html'}{$stat} ||= sub {
   `add_submit'}
   http-vote
$config{'disable_slow'}
del: query_count
query detect
pages


web: maxplaylist
     CONNECTION, REPAIR, RETRY, ...

filter_handler bad name

die icmp ping requires root privilege at /home/search/web/index.cgi line 321 
dbg p[must be non null]= host= 10.2.3.3 port= icmp
web pinging dchub://zz/zz

upload test and mark /incoming upload ...


repair- file=ftp://

test & repair --once

dc: cmd->split->parse optimize
http://www.perl.com/pub/a/2004/06/25/profiling.html

filebase: id , unique

tiger search without tiger field

sqlite: check max varchar length

describe in config.pl.dist full utf mode

js: cookie: saved searches&queies codepage convert on codepage change

rss: #x link : filter view=

====to release:
doc: purge too old
     config: conf

cut long path/filenames





===ipnorm:
add from:
crawler.pl: cmdline, file=, range scan  ->> $processor{'scan_proto_host'}
web add -> $config{'out'}{'html'}{'add_submit'}



sub normalize_ip_noc {    #v3
  my ($host) = @_;
  my @hostent;
  return $host unless @hostent = gethostbyname($host);
  return $hostent[0] unless $config{'host_by_name_norm'}
                            && $hostent[0] eq inet_ntoa($hostent[4])
                            && ( $host = ( gethostbyaddr($hostent[4], AF_INET) )[0] );
  foreach my $repl ( @{ $config{'ip_normalize_pre'} } ) {
    last if $hostent[0] =~ /^$repl\./;
    my $host_repl;
    ($host_repl = $host) =~ s/^[^.]+/$repl/;
    return $host_repl if grep($hostent[4], ( gethostbyname($host_repl) )[ 4 .. 14 ] );
    $host_repl = $repl . '.' . $host;
    return $host_repl if grep($hostent[4], ( gethostbyname($host_repl) )[ 4 .. 14 ] );
  }
  return $host;
}

proxy:
sorry, error:
size failed: SIZE not allowed in ASCII mode


dchub: update res stat after scan


ls-lr:
select from many exts (bz2 gz Z .)
skip smaller 10k ?
skop bigger 50m ? (test)
skip deeper 3l 
skip older 2 month

where: by ip (and dc too)

mod_perl & fcgi state

pg: fuzzystrmatch.sql

web: correct /path.ext/ show (link to path.ext)

http -> dig
dig -> http with stable virtual hosts
dig -> check ips in ranges/config/file 

file:// -> last files -> check codepage


around scan - get netlist from netstat -rn || route print

limit for dc download (bytes/files)

[269s] mp3-> hh:mm:ss

utf8: dc? ip length xxx.xxx.xxx.xxx


mysql 4.1.7
    $config{'sql'}{'driver'} = 'mysql4';
ON DUPLICATE KEY UPDATE  errors


sql query comment /*q=xxx ...*/

finish new lengths config

http: codepage from heads,xml, meta, auto

dont save as dead:
Warning: Unable to open interface nfe0 -- skipping it.
Warning: Unable to open interface nfe0 -- skipping it.
WARNING: Unable to find appropriate interface for system route to 84.110.12.25
nexthost: failed to determine route to 82.198.2.0
QUITTING!


http://proisk.ru/?ext=wad&on_page=20 gtp broken?

codepage select-> adjust panel


pssql: http://127.0.0.1/search/?q=Signal+To+Noise++Travelling+Chip&debug=on

try lock LOW_PRIORITY WRITE


http://ru.wikipedia.org/w/index.php?title=Magnet-%D1%81%D1%81%D1%8B%D0%BB%D0%BA%D0%B0&stable=0&redirect=no
xs as? 
mt http://rakjar.de/gnuticles/MAGMA-Specsv22.txt


 drw-rw-rw-   1 user     group           0 Oct 12 01:02  - Le tango des gens


('http','172.20.102.117','/hlam','12%20-%20%d0%9a%d0%b0%d0%bb%d0%b0%d0%bc%d0%b1%d0%b8%d1%8f%20%d0%bf%d0%b8%d1%87%d0%ba%d0%b5%d1%
80%d0%b7%20%d0%be%d1%85%d1%80%d0%b5%d0%bd%d0%b5%d0%b2%d0%b0%d0%b5%d1%82','mp3','1','0','','1232722849','1232720350','mp 3 12 20
20 d 0 9 a d 0 b 0 d 0 b d 0 b 0 d 0 bc d 0 b 1 d 0 b 8 d 1 8 f 20 d 0 bf d 0 b 8 d 1 87 d 0 b d 0 b 5 d 1 80 d 0 b 7 20 d 0 b d
 1 85 d 1 80 d 0 b 5 d 0 bd d 0 b 5 d 0 b 2 d 0 b 0 d 0 b 5 d 1 82'),                                                        ^

root   99411 98.4  0.3 65120 26108  p2  R+   12:14AM 559:33.84 crawler.pl: scan: file://b6330424.static.corbina.ru (perl5.8.9)


Can' call method "prepare on an undefine valu at pslib/pssql.pm line 813.

      
 dmp do:[ UPDATE IGNORE `host` SET `scan`='1257963964', `time`='1257963964' WHERE `host`='192.168.12.88' AND `dcuser`='' ] = 0 per 0,000s

remove ./Net - standalone, from cpan

file://user:pass@host -> smbclient -Uuser%pass


http://proisk.ru/?debug=on&prot=file&path=%2F&size=0
no size=0 in form


http://proisk.ru/?prot=file&path=%2F&name=%2A%24&size=0
!! file://77.232.19.105/print$ Disk C$ Disk IPC$ IPC ADMIN$

contain counters

2010/11/30-02:54:39 [74746] dev HandleError DBD::mysql::st execute failed: MySQL server has gone away DBI::st=HASH(0x8037cc960)  2006 MySQL server has gone away
2010/11/30-02:54:49 [74746] dev HandleError DBD::mysql::st execute failed: MySQL server has gone away DBI::st=HASH(0x8037ef4b0)  2006 MySQL server has gone away

uniout -> unref

rewrite: ext: .[^.]+  not .ext.!
name.ext rollback to q=name.ext





sphinx install freebsd:
cd /usr/ports/textproc/sphinxsearch-devel/ && make install clean
cp /usr/local/www/search/tools/sphinx.conf /usr/local/etc
ee /usr/local/etc/sphinx.conf
/usr/local/etc/rc.d/sphinxsearch restart
cd /usr/local/www/search/
ee config.pl
 $config{'use_sphinx'} = 1; # UNCOMMENT ME line ~20
# DATABASE DROP!!!
perl crawler.pl drop=filebase install
#scan something 
indexer filebase
#goto web and enjoy

dont download duplicarte filelists by cid


$config{'use_dc_user_dupes'} -- save in res


file://85.210.158.210/	 85.210.158.21 [54]


dchub://nfsn.no-ip.com

http://127.0.0.1/search/test%201?&debug=on&order=name
querystat.query = 'test 1' AND LIMIT 15 


write doc about freebsd nfs:
nfs_client_enable="YES"


more than 100:
http://test.proisk.ru/?debug=on&debug1=on&page=4&q=%D1%82%D1%8B+%D1%85%D1%83%D0%B9&debug=on



no gotopager
http://proisk.ru/?ext=apk&name=Advanced+Task+Manager+(4.0.1)&size=170235&debug=on
