Get Gentoo!
gentoo.org sites
gentoo.org Wiki Bugs Forums Packages
Planet Archives Sources
Infra Status
aboutsummaryrefslogtreecommitdiff
path: root/roverlay/remote
Commit message (Collapse)AuthorAgeFilesLines
* run rsync with /dev/null as stdinAndré Erdmann2014-12-161-1/+1
|
* unify subprocess on-exception codeAndré Erdmann2014-12-161-50/+64
| | | | make sure to terminate/kill subprocesses on error.
* roverlay/remote/websync: show download statusAndré Erdmann2014-02-161-7/+32
|
* roverlay/remote/websync: cleanupAndré Erdmann2014-02-161-14/+25
| | | | | | | * create distdir with mkdir_p=True (similar to rsync repo) * print total number of files that will be synced * _dosync(): check want_retry before retval * _fetch_package_list(): add timeout to urlopen
* config: add WEBSYNC_TIMEOUT optionAndré Erdmann2014-02-152-6/+5
| | | | | | | This controls the timeout behavior for websync repos (urlopen()). Other changes: * RSYNC_BWLIMIT's config key is now REPO.rsync_bwlimit (was RSYNC_BWLIMIT)
* roverlay/remote/websync: handle connection timeoutsAndré Erdmann2014-02-151-12/+48
| | | | | Wait up to URLOPEN_TIMEOUT(=10) seconds before giving up (and setting want_retry). The timeout value cannot be changed in the config file.
* roverlay/remote/websync: catch exceptionsAndré Erdmann2014-02-151-14/+60
| | | | | | | Catch "unknown"/unhandled exceptions from urllib et al and set the repo's status accordingly (similar to RsyncRepo). Additionally, be a bit more specific about sync errors.
* roverlay/remote/rsync: remote redundant _set_statusAndré Erdmann2014-02-151-12/+13
| | | | | | RsyncRepo->_dosync(): don't call _set_ready()/_set_fail() This is done by BasicRepo->sync() anyway.
* minor fixesAndré Erdmann2013-12-111-9/+10
| | | | | This commit fixes some issues, most of them are theoretical only, e.g. variables that might be accessed before assignment in with/try..except blocks.
* roverlay/: misc fixup (#1)André Erdmann2013-09-164-11/+7
| | | | remove unused imports, fix undefined/unused args etc.
* repolist: create_repo_identifier_map()André Erdmann2013-09-031-0/+4
| | | | returns a dict< repo_name->repo_id >
* roverlay/remote/basicrepo: use counter as identAndré Erdmann2013-09-031-3/+10
| | | | | this allows to sort repos based on their ids (where lower number means that the repo has been read earlier from the repo config file(s)).
* roverlay/remote/basicrepo: get_identifier()André Erdmann2013-09-021-0/+4
|
* roverlay/remote: fix typoAndré Erdmann2013-08-291-1/+1
| | | | s/repo_name/repo.name
* roverlay/remote/repolist, sync(): greedy on demandAndré Erdmann2013-08-071-4/+21
| | | | | | | RepoList.sync() returns success(True/False) now. Additionally, it accepts a fail_greedy arg, which causes sync to immediately abort on failure. This behavior is disabled by default (as it used to be prior to this commit).
* roverlay/remote/basicrepo: fix minor typoAndré Erdmann2013-08-071-1/+1
|
* stats collection: overlay creation, timestatsAndré Erdmann2013-07-261-1/+10
|
* stats collection: repolist, distmapAndré Erdmann2013-07-241-9/+7
|
* roverlay/remote: more accurate (no)sync loggingAndré Erdmann2013-07-242-8/+39
|
* roverlay/remote/websync: use sys.hexversionAndré Erdmann2013-07-241-1/+1
|
* repolist: log more details about ignored reposAndré Erdmann2013-07-241-2/+8
|
* roverlay/remote/websync, retry: skip fetched filesAndré Erdmann2013-07-231-80/+141
| | | | | | | Entirely skip files that have already been downloaded in "this" roverlay run. roverlay would've already skipped the actual download of existing files (if filesize,.. match), but this commit adds functionality to skip fetching _before_ opening a connection.
* roverlay/remote/websync: retry on sync errorAndré Erdmann2013-07-231-19/+94
| | | | | | | | | | | Renamed _dosync() to _sync_packages(). _dosync() calls _sync_packages() and retries that up to MAX_WEBSYNC_RETRY times if a "known" url/http exception is caught (known := known and it makes sense to retry). Retry behavior needs some fine-tuning (e.g. don't try to refetch already downloaded packages - this (sooner or later) causes a connection timeout for me).
* roverlay/remote/rsync: minor fixupAndré Erdmann2013-07-231-1/+1
| | | | don't use a string for the undefined value if "None" does it as well.
* roverlay/remote: print repo name while syncingAndré Erdmann2013-07-161-0/+2
|
* retabgsoc2013_start_codingAndré Erdmann2013-06-045-1120/+1120
| | | | Consistently use spaces instead of tabs for indention.
* remote, package_nofail: call update() onceAndré Erdmann2012-08-131-7/+6
|
* package_nofail: add src_uri_base to successful PackageInfos onlyAndré Erdmann2012-08-111-2/+5
|
* pkglist websync: expand ~ in pathsAndré Erdmann2012-08-101-1/+9
|
* remove unused importAndré Erdmann2012-08-101-1/+0
|
* fix SRC_URI for packages from subdirectoriesAndré Erdmann2012-08-091-9/+30
|
* code comments and GPLAndré Erdmann2012-08-066-0/+58
|
* comments, string formatting and strutilAndré Erdmann2012-08-022-11/+9
|
* rsync: remove --delete from default optsAndré Erdmann2012-08-021-18/+12
|
* websync: py2, urllib2 <> py3, urllib.requestAndré Erdmann2012-08-021-9/+23
|
* fix logger message in BasicRepo._package_nofail()André Erdmann2012-08-011-2/+2
|
* remote: get packages via httpAndré Erdmann2012-07-315-197/+536
|
* typoAndré Erdmann2012-07-091-1/+1
|
* apply distroot changes to RemoteRepo/RsyncRepoAndré Erdmann2012-07-062-15/+47
| | | | | | | * also added the possibility to retry rsync transfers on certain error codes modified: roverlay/remote/basicrepo.py modified: roverlay/remote/rsync.py
* remote: add force_distrootAndré Erdmann2012-07-042-24/+92
| | | | | | | also added a per RepoList DISTROOT variable modified: roverlay/remote/repolist.py modified: roverlay/remote/repoloader.py
* remote/basicrepoAndré Erdmann2012-07-041-17/+54
| | | | | | | * scan_distdir(): don't fail during PackageInfo creation * added distroot to LocalRepo initialization modified: roverlay/remote/basicrepo.py
* add sync_enabled keyword to RepoAndré Erdmann2012-07-031-2/+2
|
* remote moduleAndré Erdmann2012-06-275-103/+182
| | | | | | | | | | | | * merged RsyncRepo (repo.py) and RsyncJob (rsync.py) * added comments * added a package filter for scan_distdir() modified: roverlay/remote/basicrepo.py deleted: roverlay/remote/repo.py modified: roverlay/remote/repolist.py modified: roverlay/remote/repoloader.py modified: roverlay/remote/rsync.py
* use dodir instead of makedirsAndré Erdmann2012-06-261-5/+3
|
* use parser.get without fallback keywordAndré Erdmann2012-06-261-2/+7
| | | | | | | * using get (configparser) without the fallback keyword if python version is < 3.2 modified: roverlay/remote/repoloader.py
* remoteAndré Erdmann2012-06-265-66/+190
| | | | | | | | | | * can now be used to feed the overlay creation package queue modified: roverlay/remote/basicrepo.py modified: roverlay/remote/repo.py modified: roverlay/remote/repolist.py modified: roverlay/remote/repoloader.py modified: roverlay/remote/rsync.py
* the remote module (used for repo syncing)André Erdmann2012-06-256-0/+507
* this modules handles repositories, both local (directory) and remote (currently only rsync) * some parts, mainly integration into roverlay, are todo new file: roverlay/remote/__init__.py new file: roverlay/remote/basicrepo.py new file: roverlay/remote/repo.py new file: roverlay/remote/repolist.py new file: roverlay/remote/repoloader.py new file: roverlay/remote/rsync.py