summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2020-08-10updated catalan translationsAleix Vidal i Gaya
See merge request !127 for more information.
2020-08-10Do not retry on failure to fetchJulian Andres Klode
While we fixed the infinite retrying earlier, we still have problems if we retry in the middle of a transfer, we might end up resuming downloads that are already done and read more than we should (removing the IsOpen() check so that it always retries makes test-ubuntu-bug-1098738-apt-get-source-md5sum fail with wrong file sizes). I think the retrying was added to fixup pipelining messups, but we have better solutions now, so let's get rid of it, until we have implemented this properly.
2020-08-05basehttp: Correctly handle non-transient failure from RunData()Julian Andres Klode
When we failed after a retry, we only communicated failure as transient, but this seems wrong, especially given that the code now always triggers a retry when Die() is called, as Die() closes the server fd. Instead, remove the error handling in that code path, and reuse the existing fatal-ish error code handling path.
2020-08-05http: Fix infinite loop on read errorsJulian Andres Klode
If there was a transient error and the server fd was closed, the code would infinitely retry - it never reached FailCounter >= 2 because it falls through to the end of the loop, which sets FailCounter = 0. Add a continue just like the DNS rotation code has, so that the retry actually fails after 2 attempts. Also rework the error logic to forward the actual error message.
2020-08-04Release 2.1.8Julian Andres Klode
2020-08-04Merge branch 'pu/http-fixes-2' into 'master'Julian Andres Klode
Pu/http fixes 2 See merge request apt-team/apt!125
2020-08-04Merge branch 'master' into 'master'Julian Andres Klode
Support marking all newly installed packages as automatically installed See merge request apt-team/apt!110
2020-08-04Merge branch 'pu/less-slaves' into 'master'Julian Andres Klode
Remove master/slave terminology See merge request apt-team/apt!124
2020-08-04Replace whitelist/blacklist with allowlist/denylistJulian Andres Klode
2020-08-04gpgv: Rename master to primaryJulian Andres Klode
2020-08-04CMake/Translations: Replace master with primaryJulian Andres Klode
2020-08-04aptwebserver: Rename slaves to workersJulian Andres Klode
Apologies.
2020-08-04Merge branch 'pu/apt-key-deprecated' into 'master'Julian Andres Klode
Fully deprecate apt-key, schedule removal for Q2/2022 See merge request apt-team/apt!119
2020-08-04http: Always write to the file if there's something to writeJulian Andres Klode
We only add the file to the select() call if we have data to write to it prior to the select() call. This is problematic: Assuming we enter Go() with no data to write to the file, but we read some from the server as well as an EOF, we end up not writing it to the file because we did not add the file to the select. We can't always add the file to the select(), because it's basically always ready and we don't want to wake up if we don't have anything to read or write. So for a solution, let's just always write data to the file if there's data to write to it. If some gets leftover, or if some was already present when we started Go(), it will still be added to the select() call and unblock it. Closes: #959518
2020-07-25Merge branch 'pu/http-fixes' into 'master'Julian Andres Klode
Pu/http fixes See merge request apt-team/apt!122
2020-07-24http: Redesign reading of pending dataJulian Andres Klode
Instead of reading the data early, disable the timeout for the select() call and read the data later. Also, change Read() to call only once to drain the buffer in such instances. We could optimize this to call read() multiple times if there is also pending stuff on the socket, but that it slightly more complex and should not provide any benefits.
2020-07-24http: On select timeout, error out directly, do not call Die()Julian Andres Klode
The error handling in Die() that's supposed to add useful error messages is not super useful here.
2020-07-24http: Finish copying data from server to file before sending stuff to serverJulian Andres Klode
This avoids a case where we read data, then write to the server and only then realize the connection was closed. It is somewhat slower, though.
2020-07-24http: Die(): Do not flush the buffer, error out insteadJulian Andres Klode
By changing the buffer implementation to return true if it read or wrote something, even on EOF, we should not have a need to flush the buffer in Die() anymore - we should only be calling Die() if the buffer is empty now.
2020-07-24http: Only return false for EOF if we actually did not read anythingJulian Andres Klode
This should avoid the need to Flush the buffer in Die(), because if we read anything, we are returning true, and not entering Die() at that point. Also Write() does not have a concept of EOF, so get rid of code handling that there. Was that copied from Read()?
2020-07-24http: Die(): Merge flushing code from Flush()Julian Andres Klode
Die() needs its own Copy() of Flush() because it needs to return success or failure based on some states, but those are not precisely the same as Flush(), as Flush() will always return false at the end, for example, but we want to fall through to our error handling.
2020-07-24http: Always Close() the connection in Die()Julian Andres Klode
If we reached Die() there was an issue with the server connection, so we should always explicitly close it.
2020-07-14CMake: Rename add_slaves() to add_links()Julian Andres Klode
Sorry!
2020-07-08Release 2.1.7Julian Andres Klode
2020-07-07Detect pkg-config-dpkghook failure in tests to avoid fallbackDavid Kalnischkies
dpkg (>= 1.20.3) has better support for its own DPKG_ROOT resulting in architectures for the root being reported rather than the host system. Sadly the hookscript from pkg-config is not prepared for this resulting in our `dpkg --add-architecture` calls failing in the hook after dpkg has successfully added the architecture internally. The failure triggered fallback handling in the tests to work with an older version of dpkg with a different multi-arch implementation. So instead of doing the fallback, we ignore the failure if it seems like pkg-config-dpkghook is involved only producing a bunch of warnings to hint at this problem, but otherwise make the tests work again as it is a post-invoke script. References: #824774
2020-07-07Fix test due to display change in ls (coreutils 8.32)David Kalnischkies
The test runs ls on the opened fds and greps the result for 'root root' which is how ls (<= 8.30) used to report user and group for these. Now that Debian contains 8.32 it reports user and group of the process owning them (supposedly). grepping for both unbreaks the test. lr-x------ 1 root root 64 Jul 7 19:07 0 -> 'pipe:[10458045]' lrwx------ 1 root root 64 Jul 7 19:07 1 -> /dev/pts/12 lrwx------ 1 root root 64 Jul 7 19:07 2 -> /dev/pts/12 lr-x------ 1 root root 64 Jul 7 19:07 3 -> /proc/1266484/fd vs (assuming user:group is david:david) lr-x------ 1 david david 64 Jul 7 19:07 0 -> 'pipe:[10458045]' lrwx------ 1 david david 64 Jul 7 19:07 1 -> /dev/pts/12 lrwx------ 1 david david 64 Jul 7 19:07 2 -> /dev/pts/12 lr-x------ 1 david david 64 Jul 7 19:07 3 -> /proc/1266484/fd
2020-07-02Reorder config check before result looping for SRV parsing debugDavid Kalnischkies
It isn't needed to iterate over all results if we will be doing nothing anyhow as it isn't that common to have that debug option enabled.
2020-07-02Reorder config check before checking systemd for non-interactive httpDavid Kalnischkies
If this option is disabled (which it is by default in Debian), we don't have to make the call and the checks around it. Not that it really matters that much as if it would we would be better checking only once.
2020-07-02Dutch program translation updateFrans Spiesschaert
Closes: #963008
2020-07-02Add dependency points in the resolver also to providersDavid Kalnischkies
We were traditionally adding points for some dependency types to the real package, but we should also do it for providers of that package to help the resolver especially if the real package is for some reason not tagged for removal yet/anymore. While at it we ensure that the points are only attributed once for each package as especially with versioned provides a package can nowadays provide another many times and would hence acquire a lot of points.
2020-07-02Filter out impossible solutions for protected propagationDavid Kalnischkies
If the package providing the given solution is tagged already for removal (or at least for "not installing") we can ignore this solution as a possibility as it is not one, which means we can avoid exploring the option and potentially forward the protected flag further if that helps in reducing the possibilities to a single one.
2020-07-02Delay removals due to Conflicts until Depends are resolvedDavid Kalnischkies
Marking a package for removal is fine if we know that we have to remove that package, but if we are in an alternative branch we might not go this route in the end and hence have a package pointlessly marked for removal which isn't questioned later on. We check if we are allowed to remove that package to avoid working on the positive dependencies if not, but we mark them for removal only after all the other dependencies are successfully resolved. In an ideal world we would let the problemResolver do its job on them, but the resolver might decide against doing the removal exploring another option like the next alternative, which might be a good idea, but is not the behaviour we had before, so that is the best we can do for now without changing the resolver drastically.
2020-07-01Merge branch 'patch-1' into 'master'Julian Andres Klode
Minor Catalan grammar typo See merge request apt-team/apt!123
2020-06-30Minor Catalan grammar typoSergio Oller Moreno
2020-06-29Add basic support for the Protected fieldJulian Andres Klode
This will be mapped to Important for the time being.
2020-06-23Replace some magic 64*1024 with APT_BUFFER_SIZEJulian Andres Klode
2020-06-14Deduplicate EDSP Provides line of M-A:foreign packagesDavid Kalnischkies
M-A:foreign causes Provides to apply to all architectures and as we wanted to avoid resolver changes for M-A those are done by explicitly creating these provides instead of forcing the resolvers to learn about this. The EDSP is a different beast though & we don't need this trick here especially as it leads to needless (but harmless) duplication. No sort+unique is done to avoid changing order (not that it should matter, but just to be sure), but the sets should be small enough to not make a huge difference either way.
2020-06-14Tell EDSP solvers about all installed pkgs ignoring archDavid Kalnischkies
We usually tell EDSP solvers only about architectures we are configured to treat as native/foreign, but the system could have packages from other architectures installed (even if very unlikely) which could influence the solution (e.g. requiring a removal) so we make sure to tell them.
2020-06-14Do not sent our filename-provides trick to EDSP solversDavid Kalnischkies
If package is installed via an explicitly given deb file we store the filename as a provides, so that the frontend can request the filename and get the usual "Selected foo instead of foo.deb" message. We do not need to trouble the EDSP solvers with that though as these provides are not valid in various ways and we have already solved the link between commandline and package (and version) for them. Closes: #962741
2020-06-14Portuguese manpages translation updateAmérico Monteiro
Closes: #962483
2020-06-08Support marking all newly installed packages as automatically installedNicolas Schier
Add option '--mark-auto' to 'apt install' that marks all newly installed packages as automatically installed. Signed-off-by: Nicolas Schier <nicolas@fjasle.eu>
2020-06-06Do not hardcode (wrong) group and mode in setup warningDavid Kalnischkies
Partial directories are created with 0700, but the parent is 0755, while the error message would report 0700 for both… that isn't right and can be pretty confusing. Turns out that the messages aren't marked for translation, so no unfuzzing is required & we just leave it as untranslated for now. Especially as the more detailed error strings derived from errno are translated. Reported-By: Wakko Warner <wakko@animx.eu.org> Closes: #962310
2020-06-03Release 2.1.6Julian Andres Klode
2020-06-03Deal with duplicates in the solution space of a depDavid Kalnischkies
While we process the possible solutions we might modify other solutions like discarding their candidates and such, so that then we reach them they might no longer be proper candidates. We also try to drop duplicates early on to avoid the simple cases of these which test-explore-or-groups-in-markinstall triggers via its explicit duplication but could also come via multiple provides. It only worked previously as were ignoring current versions which usually is okay expect if they are marked for removal and we want to reinstate them so the ProblemResolver can decide which one later on.
2020-06-03Allow 20 instead of 10 loops for pkgProblemResolverDavid Kalnischkies
Especially if a lot packages have to be removed due to not to explicitly expressed conflicts the problem resolver can take a few turns to remove them all. Allowing it to try a little longer if needed seems beneficial as the worst which can happen is that we now take two times as long to present an error message to the user.
2020-06-02Consider if a fix is successful before claiming it isDavid Kalnischkies
For protected packages the "Fixing" done via KillList in the ProblemResolver will usually not happen as the state change is not allowed, so the debug message is just confusing and the resolver is needlessly looping here (which might push it over the edge), so if we didn't do our thing successfully here we short-circuit a bit to help the next iteration come to a solution.
2020-05-29Consider protected packages for removal if they are marked as suchDavid Kalnischkies
The pkgProblemResolver incorrectly skips protected packages while considering packages for removal, which was always wrong but is now a lot more visible as (potentially) far more packages are considered protected in their state. Note that the testcase shows that we need more changes to make this proper.
2020-05-27Fix small memory leak in MethodConfigDavid Kalnischkies
We are leaking a d-pointer currently weighting a boolean in size and MethodConfig is instantiated in small numbers only, so nobody will actually notice a difference, but proper cleanup is important. Reported-By: clang LeakSanitizer References: 04ab37fecaf286f724bef2e0969d2b67ab5ac1b1
2020-05-26Release 2.1.5Julian Andres Klode
2020-05-25Dutch manpages translation updateFrans Spiesschaert
Closes: #961431