Changelog¶
3.42.0 (2023-11-28)¶
REST API¶
Features¶
Added instrumentation to content-app to track telemetry data. #3829
Bugfixes¶
Fixed that pulp_file presented its python_package as pulp_file instead of pulp-file. #4724
Plugin API¶
No significant changes.
Pulp File¶
No significant changes.
3.41.1 (2023-11-21)¶
REST API¶
Bugfixes¶
Fixed that pulp_file presented its python_package as pulp_file instead of pulp-file. #4724
Plugin API¶
No significant changes.
Pulp File¶
No significant changes.
3.41.0 (2023-11-14)¶
REST API¶
Features¶
Added a
--restartoption to pulpcore worker. This requires “hupper” to be installed. #+pulpcore-worker-restartAdded new management command
repository-sizethat calculates the total size in bytes of files stored in repositories. #2079
Bugfixes¶
Plugin API¶
Features¶
Bugfixes¶
Added ADD_TRAILING_SLASH property to AsyncContentCache. The default value is True. By default, AsyncContentCache will call into Handler._match_distribution(path, add_trailing_slash=True). If the meaning of the Distribution’s base_path changes when a trailing slash is added, this method will not match such a Distribution. In this case, AsyncContentCache.ADD_TRAILING_SLASH should be set to False. #4634
Fixed how Distribution.content_handler() is called in the content app. #4644
Fixed content app returning 404s on directory index pages for some published plugins. #4654
Removals¶
Removed the ability to call functions defined outside of pulp components as the target of a task. #4651
Pulp File¶
Bugfixes¶
Fix pulp_file advertised version. #4633
3.40.4 (2023-11-08)¶
REST API¶
Bugfixes¶
Restored the ability to set
--max-requests-jitteron service entrypoints. #4679
Plugin API¶
No significant changes.
Pulp File¶
No significant changes.
3.40.3 (2023-11-07)¶
REST API¶
Bugfixes¶
Closed the window when serializer.get_or_create could raise ObjectDoesnotExist. #4648
Plugin API¶
No significant changes.
Pulp File¶
No significant changes.
3.40.2 (2023-11-06)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Fixed content app returning 404s on directory index pages for some published plugins. #4654
Pulp File¶
No significant changes.
3.40.1 (2023-11-02)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Added ADD_TRAILING_SLASH property to AsyncContentCache. The default value is True. By default, AsyncContentCache will call into Handler._match_distribution(path, add_trailing_slash=True). If the meaning of the Distribution’s base_path changes when a trailing slash is added, this method will not match such a Distribution. In this case, AsyncContentCache.ADD_TRAILING_SLASH should be set to False. #4634
Fixed how Distribution.content_handler() is called in the content app. #4644
Pulp File¶
Bugfixes¶
Fix pulp_file advertised version. #4633
3.40.0 (2023-10-31)¶
REST API¶
Features¶
Removals¶
Plugin API¶
Features¶
Handler._match_distribution() method now accepts add_trailing_slash keyword argument. When set to False, the content app will not try to append a ‘/’ to the path before trying to match it to a distribution. Plugin code that calls this method directly needs to be updated to account for the desired behavior. #3459
Removals¶
The changes introduced to the content upload serializers need adjustments in dome plugins. Specifically plugin that implemented their own notion of deferred validation to
NoArtifactContentUploadSerializerseem to be affected. #4348
Pulp File¶
Features¶
Starting from this release pulp_file will be shipped as part of the pulpcore package. #4550
3.39.3 (2023-11-15)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.39.2 (2023-11-08)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.39.1 (2023-10-31)¶
REST API¶
No significant changes.
Plugin API¶
No significant changes.
3.39.0 (2023-10-25)¶
REST API¶
Features¶
Added a
HeaderContentGuardto allow a content access based on a valued provided by a specific header. The header can optionally be filtered through ajqexpression. #4518
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.38.1 (2023-10-28)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.38.0 (2023-10-19)¶
REST API¶
Features¶
Bugfixes¶
Stopped reassembling the tarball of a chunked import into one large file, and instead gather the bits on the fly. This also allows importing directly from a read-only medium. #4545
Improve performance during export operations. #4551
Taught ContentArtifactResource import to cache content results to improve performance. #4564
Misc¶
Plugin API¶
No significant changes.
3.37.0 (2023-10-05)¶
REST API¶
Features¶
Include social_django urls based on config option #4511
Bugfixes¶
Added
formatparam toDEFAULT_FILTERSinBaseFilterSetto fix django api format. #4450
Plugin API¶
No significant changes.
3.36.0 (2023-09-27)¶
REST API¶
Features¶
Bugfixes¶
Removals¶
Exports now take place in .tar format rather than .tar.gz. It was previously found that the compression provided little benefit but came with large runtime costs, so the compression level was reduced to 0. However even packaging the data in a gzip archive without compression comes with performance costs (particularly on import), so, we remove that layer entirely. #4446
Plugin API¶
No significant changes.
3.35.0 (2023-09-20)¶
REST API¶
Features¶
Added RBAC for UpstreamPulp APIs. #3994
Added filters
name__regexandname__iregexto various endpoints. #4432Enabling the TASK_DIAGNOSTICS option now additionally creates a profile of all executed tasks if the pyinstrument package is installed. This incurs a small overhead on task runtime (5-10%). #4436
Bugfixes¶
Added encryption to task argument fields. #+enc_task_args
Fixed sync not deleting temporary files when WORKING_DIRECTORY is not a sub-directory of MEDIA_ROOT or when using a non-filesystem storage backend. #1936
Ensure non-chunked exports and chunked exports use the same compression level. #4411
Removed compression from exports (using gzip level 0). For most users of export functionality it seems to be a poor tradeoff. #4434
Fixed bug where supplying an empty list for
pulp_href__inorpulp_id__inwould return all results instead of none. #4437
Removals¶
Removed the
pulp-contentscript that was superseeded bypulpcore-content. #+remove_old_script
Plugin API¶
No significant changes.
3.34.0 (2023-09-12)¶
REST API¶
Bugfixes¶
Plugin API¶
Features¶
Added a
LabelsMixinfor views to allow syncronous manipulation of labels on existing objects. Repository, remote and distribution views inherit this from pulpcore, but default access policies need to be adjusted. #3332Added a migration operation
RequireVersionthat refuses to complete as long as active server components exist in the database. #3401
3.33.0 (2023-09-06)¶
REST API¶
Features¶
Added a filter q that supports complex filter expressions.
This feature is in tech-preview for the time being. #2480, #3914
Add status records for api apps. #3175
Added
set_labelandunset_labelendpoints to allow manipulating individual labels synchronously. #3332Added
--burstflag to pulpcore-worker so it will terminate instead of sleeping. #4341
Bugfixes¶
Fixed an exception that gets raised inside the domain delete hook when there are still repositories with content in the domain. #4157
Made orphan clean up more tolerant when other tasks are running in parallel. #4316
Fix the label migration 0104 to allow upgrading from before 3.25. #4319
Fixed Distribution validation for PUT calls when the data source changes. #4324
Ensure the compression level is reliably set properly as per #3869. #4351
Fix encrypted fields to use json instead of repr/eval and make them fit for
bulk_update. This solves an issue withpulpcore-manager rotate-db-keycorrupting data. #4359
Removals¶
Starting with this release, it is highly recommended to start the api and content processes by the newly provided entrypoints (
pulpcore-apiandpulpcore-content) instead of callinggunicorndirectly. #3175
Plugin API¶
Features¶
Added a
LabelsMixinfor views to allow syncronous manipulation of labels on existing objects. Repository, remote and distribution views inherit this from pulpcore, but default access policies need to be adjusted. #3332
3.32.1 (2023-09-06)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.32.0 (2023-08-22)¶
REST API¶
Bugfixes¶
Plugin API¶
Features¶
Made the current domain a shared resource for all tasks even with domains disabled, so tasks can hold off all other operations by taking an exclusive lock on the (default) domain. #4285
3.31.0 (2023-08-15)¶
REST API¶
Bugfixes¶
Plugin API¶
Features¶
Added memoized
system_idfunction to the plugin api. #4276
3.30.0 (2023-08-08)¶
REST API¶
Bugfixes¶
Resolved a memory leak that could occur while making large repeated queries against the API service. #2250
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Fixed a bug with the replicate API not handling Upstream Pulp API over HTTPS. #3910
Fixed duplicate OpenAPI operation ids when using domains. #3977
Updates file system exporter to correctly account the start_repository_version for pass_through publications #4051
Taught pulp-import to be able to use a subset of available worker-threads. #4068
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Taught repair task to be tolerant in the face of any artifact download failure. #4111
Fixed a 500 error for Upstream Pulp Replicate API when domains are enabled. #4119
Fixed the OpenAPI schema for the ‘replicate’ operation response. #4121
Fixed a bug where repositories were getting deleted accross domains. #4158
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Fixed bug where the Task Group for replication would be marked as fully dispatched after just one replicator. #4175
Fixed a 500 server error when two concurrent requests try to create an object with the same unique fields. #4183
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Fixed a bug where replication remotes did not have their URLs updated on subsequent runs. #4218
Fixed a bug where ca_cert was not getting set for replication remotes. #4219
Correctly fixed pulp_rpm-export-edgecase - fix #4210 was incomplete. #4231
Fixed bug where tls_validation, client_key, and client_cert were not getting set on replication remotes. #4247
Misc¶
Plugin API¶
Features¶
Adjusted the
BaseDownloader.fetch()method to acceptextra_data. #4229
3.29.8 (2023-08-08)¶
REST API¶
Bugfixes¶
Fixed bug where tls_validation, client_key, and client_cert were not getting set on replication remotes. #4247
Plugin API¶
No significant changes.
3.29.7 (2023-08-01)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.29.6 (2023-07-31)¶
REST API¶
Bugfixes¶
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.29.5 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Fixed a bug with the replicate API not handling Upstream Pulp API over HTTPS. #3910
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Fixed a bug where repositories were getting deleted accross domains. #4158
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Fixed bug where the Task Group for replication would be marked as fully dispatched after just one replicator. #4175
Misc¶
Plugin API¶
No significant changes.
3.29.4 (2023-07-25)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.29.3 (2023-07-22)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.29.2 (2023-07-19)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.29.1 (2023-07-14)¶
REST API¶
Bugfixes¶
Pinned importlib-metadata to 6.0.1 given pip is unable to solve an opentelemetry dependency version correctly. #4042
Plugin API¶
No significant changes.
3.29.0 (2023-07-12)¶
REST API¶
Features¶
Added version information to tasks. Workers will refuse to pick up tasks with a version higher than their own. #3369
Added graceful shutdown to pulpcore-worker without killing the current task on receiving
SIGHUPorSIGTERM. #3940Added periodically executed cleanup tasks for uploads and temporary files. Configure a time interval in
UPLOAD_PROTECTION_TIMEorTMPFILE_PROTECTION_TIMEto activate. #3949
Bugfixes¶
Plugin API¶
Features¶
Added
retrievelogic toMultipleArtifactContentSerializer. #3951
Bugfixes¶
Fixed the import path for
pulpcore.plugin.pulp_hashlib. #4006
Misc¶
3.28.19 (2023-11-06)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.28.18 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.28.17 (2023-10-05)¶
REST API¶
Bugfixes¶
Added
formatparam toDEFAULT_FILTERSinBaseFilterSetto fix django api format. #4450
Plugin API¶
No significant changes.
3.28.16 (2023-09-27)¶
REST API¶
Features¶
Enabling the TASK_DIAGNOSTICS option now additionally creates a profile of all executed tasks if the pyinstrument package is installed. This incurs a small overhead on task runtime (5-10%). #4436
Bugfixes¶
Fixed sync not deleting temporary files when WORKING_DIRECTORY is not a sub-directory of MEDIA_ROOT or when using a non-filesystem storage backend. #1936
Made the incremental file export include all published metadata. #3941
Fixed the return value of
get_users_with_perms_attached_rolesto give proper role names. #4478
Plugin API¶
No significant changes.
3.28.15 (2023-09-20)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.28.14 (2023-09-12)¶
REST API¶
Bugfixes¶
Ensured that repository and remote delete is always executed in a task. This fixes a bug when the deletion blocks the gunicorn api worker for too long. #4372
Plugin API¶
No significant changes.
3.28.13 (2023-09-06)¶
REST API¶
Bugfixes¶
Fix the label migration 0104 to allow upgrading from before 3.25. #4319
Ensure the compression level is reliably set properly as per #3869. #4351
Fix encrypted fields to use json instead of repr/eval and make them fit for
bulk_update. This solves an issue withpulpcore-manager rotate-db-keycorrupting data. #4359
Plugin API¶
No significant changes.
3.28.12 (2023-08-22)¶
REST API¶
Bugfixes¶
Plugin API¶
Features¶
Added memoized
system_idfunction to the plugin api. #4276
3.28.11 (2023-08-15)¶
REST API¶
Bugfixes¶
Taught downloader to correctly handle plugin-specified headers for object-storage backends. #4028
Plugin API¶
No significant changes.
3.28.10 (2023-08-08)¶
REST API¶
Bugfixes¶
Fixed bug where tls_validation, client_key, and client_cert were not getting set on replication remotes. #4247
Plugin API¶
No significant changes.
3.28.9 (2023-08-03)¶
REST API¶
No significant changes.
Plugin API¶
No significant changes.
3.28.8 (2023-08-01)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.28.7 (2023-07-31)¶
REST API¶
Bugfixes¶
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.28.6 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Fixed a bug with the replicate API not handling Upstream Pulp API over HTTPS. #3910
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Fixed a bug where repositories were getting deleted accross domains. #4158
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Fixed bug where the Task Group for replication would be marked as fully dispatched after just one replicator. #4175
Misc¶
Plugin API¶
No significant changes.
3.28.5 (2023-07-25)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.28.4 (2023-07-19)¶
REST API¶
Bugfixes¶
Plugin API¶
Bugfixes¶
Fixed the import path for
pulpcore.plugin.pulp_hashlib. #4006
3.28.3 (2023-07-14)¶
REST API¶
Bugfixes¶
Pinned importlib-metadata to 6.0.1 given pip is unable to solve an opentelemetry dependency version correctly. #4042
Plugin API¶
No significant changes.
3.28.2 (2023-07-12)¶
REST API¶
Bugfixes¶
Fix api schema of the upstream_pulp_replicate operation requiring no body. #3995
Plugin API¶
No significant changes.
3.28.1 (2023-06-27)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.28.0 (2023-06-14)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Fixed the method for displaying the representation of
MasterModelobjects. #3898
Improved Documentation¶
Removes leftover documentation referring to the deprecated Ansible based installer. #3834
Plugin API¶
Features¶
Added support to pull-through caching for streaming metadata files.
Remote.get_remote_artifact_content_typecan now returnNoneto inform the content app that the requested path is a metadata file that should be streamed and not saved for the pull-through caching feature. #3817Added support to pull-through caching for plugins with multi-artifact content types.
Content.init_from_artifact_and_relative_pathcan now return a tuple of the new content unit and a dict containing the mapping of that content’s artifacts and their relative paths. #3818Added Distribution.content_headers_for() to let plugins affect content-app response headers.
This can be useful, for example, when it’s desirable for specific files to be served with Cache-control: no-cache. #3897
3.27.2 (2023-07-14)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.27.1 (2023-06-05)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.27.0 (2023-05-31)¶
REST API¶
Features¶
Bugfixes¶
Improved Documentation¶
Misc¶
Plugin API¶
Features¶
Added async version of
castasacast. #3873
Bugfixes¶
Fixed potential unnecessary database calls executed after matching distributions in the content application. #3876
3.26.2 (2023-07-14)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.26.1 (2023-05-25)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Fixed potential unnecessary database calls executed after matching distributions in the content application. #3876
3.26.0 (2023-05-16)¶
REST API¶
Features¶
Improved Documentation¶
Updated examples and fixed some typos in Domains workflow doc. #3825
Plugin API¶
No significant changes.
3.25.1 (2023-05-25)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Fixed potential unnecessary database calls executed after matching distributions in the content application. #3876
3.25.0 (2023-05-10)¶
REST API¶
Features¶
Bugfixes¶
Misc¶
Plugin API¶
Features¶
Created a wrapper type for UUID generation so that the implementation can potentially be switched in the future. UUIDs are just 128-bit integers - as long as they don’t overlap there is no explicit need to stick with any particular implementation. Plugin writers may notice a migration created due to this change depending on how they have written the plugin. #3117
Bumped the database backend from psycopg2 to psycopg3. #3792
Removals¶
Removed
NamedModelViewSet.extract_pkin favor ofpulpcore.plugin.util.extract_pkandraise_for_unknown_content_unitsfrompulpcore.plugin.actions, which moved topulpcore.plugin.util. #3613Removed the deprecated verify_signature. Use gpg_verify instead. #3614
Removed
LabelsField,Label, andLabelSelectFilter. #3615Updated Django version to 4.2 LTS branch. This may introduce some breaking changes to plugins. #3660
3.24.1 (2023-05-03)¶
REST API¶
Bugfixes¶
Fixed representation of domains in created_resources on task list and show. #3783
Plugin API¶
No significant changes.
3.24.0 (2023-05-02)¶
REST API¶
Features¶
Added commands and documentation for db encryption key rotation. #2048
Added ability to filter resources by list of HREFs or IDs with
pulp_href__inandpulp_id__in. #2975Added ability to sort by type on generic list endpoints with
pulp_type__in. #3408Added file size to the content app listing. #3656
Changed most of the update and delete tasks to allow for immediate execution if not contested by other running tasks. #3661
Bugfixes¶
Fixed some deprecations in preparation to 3.25 being a breaking change release. #3023
Task purge now continues when encountering a task that could not be deleted. The user is informed about any such tasks. #3530
Fixed package timestamp on content app to reflect time package was added to the repository. #3653
Fixed import/export in the presence of the domains work. #3663
Fixed a regular expression used when listing directories. #3673
Optimized queries needed when listing Tasks. #3711
Optimized DB queries for content, distribution, publication, remote, repository, and repository-version list endpoints. #3714
Downloader will now attempt to keep the filename of the requested URL intact if one exists. #3715
Fixed returned error codes for unauthenticated users. Pulp now returns HTTP 401 errors instead of HTTP 403 errors which were default return types for
SessionAuthentication. #3730Fixed issue with deleting export tasks via purge. #3741
Closed the window for a race condition in content creation. #3754
Improved Documentation¶
Misc¶
Plugin API¶
Features¶
Added flags
immediateanddeferredtodispatchto allow specifying whether a task can be attempted to run synchronously and whether it can be deferred. #3661
3.23.22 (2023-11-23)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.21 (2023-11-14)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.23.20 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.19 (2023-10-05)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.18 (2023-09-27)¶
REST API¶
Bugfixes¶
Fixed sync not deleting temporary files when WORKING_DIRECTORY is not a sub-directory of MEDIA_ROOT or when using a non-filesystem storage backend. #1936
Ensure non-chunked exports also use gzip
compressionlevel=1#4411Fixed the return value of
get_users_with_perms_attached_rolesto give proper role names. #4478
Plugin API¶
No significant changes.
3.23.17 (2023-09-06)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.16 (2023-08-23)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.15 (2023-08-08)¶
REST API¶
Bugfixes¶
Fixed bug where tls_validation, client_key, and client_cert were not getting set on replication remotes. #4247
Plugin API¶
No significant changes.
3.23.14 (2023-08-01)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.13 (2023-07-31)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Made the incremental file export include all published metadata. #3941
Updates file system exporter to correctly account the start_repository_version for pass_through publications #4051
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.23.12 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Fixed a bug with the replicate API not handling Upstream Pulp API over HTTPS. #3910
Taught pulp-import to be able to use a subset of available worker-threads. #4068
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Fixed a bug where repositories were getting deleted accross domains. #4158
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Fixed bug where the Task Group for replication would be marked as fully dispatched after just one replicator. #4175
Misc¶
Plugin API¶
No significant changes.
3.23.11 (2023-07-25)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.10 (2023-07-22)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.9 (2023-07-19)¶
REST API¶
Bugfixes¶
Fixed duplicate OpenAPI operation ids when using domains. #3977
Plugin API¶
No significant changes.
3.23.8 (2023-07-12)¶
REST API¶
Bugfixes¶
Fix api schema of the upstream_pulp_replicate operation requiring no body. #3995
Plugin API¶
No significant changes.
3.23.7 (2023-06-14)¶
REST API¶
Bugfixes¶
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Plugin API¶
No significant changes.
3.23.6 (2023-05-30)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.5 (2023-05-23)¶
REST API¶
Bugfixes¶
Serialized global reclaim space, global repair artifacts tasks with respect to each other to prevent them from failing. #3786
Plugin API¶
No significant changes.
3.23.4 (2023-05-10)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.3 (2023-04-18)¶
REST API¶
No significant changes.
Plugin API¶
No significant changes.
3.23.2 (2023-04-11)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.1 (2023-03-27)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.23.0 (2023-03-14)¶
REST API¶
Features¶
Added a repository exact and in filters to the Distributions API. #3394
Added a new optional multi-tenancy namespacing feature: Domains. See workflow documentation for more information on this tech-preview feature. #3403
Add GCP support #3424
Added
retain_repo_versionsfilter to Repository endpoint. #3507Pass correlation id to signing script through ENV variable #3522
Added ability to replicate distributions/repositories from another Pulp. #3566
Started to collect statistics about RBAC (amd domain) usage. #3639
Bugfixes¶
Bump dynaconf version to 3.1.12 given it fixes a bug to handle failures when pwd does not exist. #3310
Added validation to the repository modify endpoint. #3326
Addressed a possible N+1 query performance issue within reclaim_space task. #3404
Added repeating logic to signalling a task worker subprocess. This should fix a bug where the task refuses to be terminated easily. #3407
Added a
start_repository_versionparameter to the file system exporter.If specified, it will export only content units that differed between two repository versions. #3413
Fixed the label migration code for not null constraint errors when objects with and without labels are migrated. #3495
Added int64 format to integer fields in api schema. #3590
Fixed a bug that caused Pulp to return duplicate content when a user was logged in as a non-superuser while the content was part of multiple repositories. #3641
Added missing validation to the
repairendpoint. #3645Fixed bug related to pulpcore-content serving content from a remote (pull-through-cache). #3654
Improved Documentation¶
Revisited features in tech preview (e.g., ACS, RBAC, metadata signing, import/export) and marked them production ready. #3429
Documented PostgreSQL version compatibility and incompatibility with transaction based connection pooling. #3505
Updated the release-process doc to be more complete. #3514
Added links to the Containerfiles used for building the pulp and pulp-minimal OCI images. #3627
Removals¶
Removed the PROFILE_STAGES_API setting along with the dependent code. #3595
Misc¶
Plugin API¶
Features¶
Refactored
ArtifactDownloaderstage logic into base classGenericDownloaderand allow for the progress reports message and code to be customized by subclasses. #1931Added version information to the worker records in the database. #3365
Added new config option
domain_compatibletoPluginAppConfigto specify Domains feature compatibility within a plugin. See Domains compatibility documentation in plugin-writer section for more information. #3403Exported
TaskSerializerinpulpcore.plugin.serializers#3506Added Replicator class that plugins can implement to enable distribution/repository replication. #3566
Exposed a function for extracting PKs from URIs and a function for validating content units (
pulpcore.plugin.util.extract_pk,pulpcore.plugin.util.raise_for_unknown_content_units). #3604Add
label_field_namearg toLabelFilter()filter that allows plugin devs to customize the model field thatLabelFilterfilters on. #3631
Bugfixes¶
Improved Documentation¶
Deprecations¶
Deprecated
NamedModelViewSet.extract_pkin favour ofpulpcore.plugin.util.extract_pk. Deprecatedpulpcore.plugin.actions.raise_for_unknown_content_unitsin favour ofpulpcore.plugin.util.raise_for_unknown_content_units. #3604
3.22.19 (2023-11-15)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.18 (2023-11-03)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.22.17 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.16 (2023-09-27)¶
REST API¶
Bugfixes¶
Fixed sync not deleting temporary files when WORKING_DIRECTORY is not a sub-directory of MEDIA_ROOT or when using a non-filesystem storage backend. #1936
Misc¶
Plugin API¶
No significant changes.
3.22.15 (2023-09-20)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.14 (2023-09-06)¶
REST API¶
Bugfixes¶
Ensure the compression level is reliably set properly as per #3869. #4351
Plugin API¶
No significant changes.
3.22.13 (2023-08-23)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.12 (2023-08-01)¶
REST API¶
Bugfixes¶
Correctly fixed pulp_rpm-export-edgecase - fix #4210 was incomplete. #4231
Plugin API¶
No significant changes.
3.22.11 (2023-07-31)¶
REST API¶
Bugfixes¶
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.22.10 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Taught pulp-import to be able to use a subset of available worker-threads. #4068
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Plugin API¶
No significant changes.
3.22.9 (2023-07-22)¶
REST API¶
Bugfixes¶
Resolved a memory leak that could occur while making large repeated queries against the API service. #2250
Added repeating logic to signalling a task worker subprocess. This should fix a bug where the task refuses to be terminated easily. #3407
Taught repair task to be tolerant in the face of any artifact download failure. #4111
Plugin API¶
No significant changes.
3.22.8 (2023-07-19)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.7 (2023-06-14)¶
REST API¶
Bugfixes¶
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Plugin API¶
No significant changes.
3.22.6 (2023-06-07)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Plugin API¶
No significant changes.
3.22.5 (2023-05-30)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.4 (2023-04-11)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.22.3 (2023-03-06)¶
REST API¶
No significant changes.
Plugin API¶
No significant changes.
3.22.2 (2023-02-02)¶
REST API¶
Bugfixes¶
Added a
start_repository_versionparameter to the file system exporter.If specified, it will export only content units that differed between two repository versions. #3413
Plugin API¶
No significant changes.
3.22.1 (2023-01-20)¶
REST API¶
Bugfixes¶
Fixed the label migration code for not null constraint errors when objects with and without labels are migrated. #3495
Plugin API¶
No significant changes.
3.22.0 (2022-12-18)¶
REST API¶
Features¶
Added dates to the HTML pages listing the content of distributions. The timestamp is of when the content was created in Pulp. #2054
Create HiddenFieldsMixin serializer and add hidden_fields to RemoteSerializer and UserSerializer. #2825
Added
pulpcore-managercommand calledremove-signing-servicefor removing specified signing services. #2967Added the option HIDE_GUARDED_DISTRIBUTIONS to allow hiding the content guard protected distributions from the listing page. #3061
Added “content_settings” stanza to the /status/ output. #3138
Added expiry to preauthenticated URLs from ContentRedirectingContentGuard. #3238
Added
reserved_resources,reserved_resources__in,exclusive_resources,exclusive_resources__in,shared_resourcesandshared_resources__infilter to task list endpoint. #3280The postgresql version is now included in analytics data posted. The payload looks like:
{`'postgresqlVersion': 90200}. The integer value is the raw format postgresql reports its version as. #3396The new
ANALYTICSsetting replaced theTELEMETRYsetting to avoid confusion with application metrics that will be exposed using OpenTelemetry. #3417
Bugfixes¶
Fixed the fs exporter to handle the case where there are pre-existing files in the location that FileSystem attempts to export to you get a FileExistsError. #1949
The logging_cid field of a task can no longer be an empty string. #3016
Fixed content-disposition header which is used in the object storage backends. #3124
Fixed the fs exporter to handle the case where hardlink method was requested but pulp and export locations are in different partitions so can’t share the same inode. #3187
Another guardrail added around content-stages to address deadlock in a specific usecase. #3192
Fixed bug where installations with at least one pre-release plugin installed were posting to the production analytics site instead of the developer analytics site. #3213
Fixed the worker__in filter for Tasks API. #3235
Do not expose artifact digest via content-disposition header when using Azure backend. #3244
Fixed a bug that disallowed non-admin users to purge completed tasks. #3263
Made ordering consistent between all list API endpoints. #3266
Another step on closing the deadlock-window when syncing overlapping content. #3284
Fixed an occasional 500 error when viewing a repository version content summary while performing a content deletion task. #3299
Fixed an error when raising
UnexportableArtifactException. #3313Hardened the state transition for tasks and ensured a canceled task will have finished_at set. #3319
Made sure PulpImport’s use of tar.extractall() is safe. #3323
Fixed content disposition header value when content is stored in Azure. #3342
Fixes schema generation to use proper type uri for
HyperlinkRelatedFilter. #3351Insured that pulp-export correctly locks repos-being-exported. #3370
Fixed the update of default access policies when fields are missing. #3391
Fixed the openapi spec of “fields” and “exclude_fields” querystring parameters. #3398
Fixed label querying performance issues. In case some labels could not be migrated properly, a
datarepair-labelscommand was added. #3400Fix migrating Remotes with @ in path #3409
Fixed the broken link on the root page served by pulpcore-content. #3436
Improved Documentation¶
Deprecations¶
TELEMETRY` setting was deprecated in favor of ``ANALYTICS. #3417
Misc¶
Plugin API¶
Features¶
Added
get_artifact_urlto emit preauthed urls to existing artifacts. #2785The upload feature was changed to accept already existing content. This allows multiple users to own identical content when working with plugins that implement the ‘retrieve’ method inside their
ContentUploadserializers. #3081Exposed
ArtifactResponseatpulpcore.plugin.responses. #3340Exposed the
get_urlutil function. #3468
Bugfixes¶
Added
BaseFilterSettoNamedModelViewSetto allow ordering on all list endpoints even without specifying a custom filterset class. #3266
Improved Documentation¶
Added documentation for plugin writers on declaring dependencies. #2997
Removals¶
Deprecated model
Labeland serializer fieldLabelFieldandLabelSelectFilterfor removal in 3.25. #3400
3.21.23 (2023-11-23)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.22 (2023-11-14)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.21.21 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.20 (2023-10-05)¶
REST API¶
Bugfixes¶
Made sure PulpImport’s use of tar.extractall() is safe. #3323
Plugin API¶
No significant changes.
3.21.19 (2023-09-27)¶
REST API¶
Bugfixes¶
Fixed sync not deleting temporary files when WORKING_DIRECTORY is not a sub-directory of MEDIA_ROOT or when using a non-filesystem storage backend. #1936
Misc¶
Plugin API¶
No significant changes.
3.21.18 (2023-09-25)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.17 (2023-09-06)¶
REST API¶
Bugfixes¶
Ensure the compression level is reliably set properly as per #3869. #4351
Plugin API¶
No significant changes.
3.21.16 (2023-08-23)¶
REST API¶
Bugfixes¶
Added repeating logic to signalling a task worker subprocess. This should fix a bug where the task refuses to be terminated easily. #3407
Improved the performance when looking up content for repository versions. #3969
Fixed bug where incorrect error message presented in relation to content-import #4294
Plugin API¶
No significant changes.
3.21.15 (2023-08-01)¶
REST API¶
Bugfixes¶
Correctly fixed pulp_rpm-export-edgecase - fix #4210 was incomplete. #4231
Plugin API¶
No significant changes.
3.21.14 (2023-07-31)¶
REST API¶
Bugfixes¶
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.21.13 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Taught pulp-import to be able to use a subset of available worker-threads. #4068
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Plugin API¶
No significant changes.
3.21.12 (2023-07-22)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.11 (2023-07-19)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.10 (2023-06-14)¶
REST API¶
Bugfixes¶
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Plugin API¶
No significant changes.
3.21.9 (2023-06-06)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Plugin API¶
No significant changes.
3.21.8 (2023-05-30)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.7 (2023-04-11)¶
REST API¶
Bugfixes¶
Downloader will now attempt to keep the filename of the requested URL intact if one exists. #3715
Plugin API¶
No significant changes.
3.21.6 (2023-03-29)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.5 (2023-02-02)¶
REST API¶
Bugfixes¶
Added a
start_repository_versionparameter to the file system exporter.If specified, it will export only content units that differed between two repository versions. #3413
Plugin API¶
No significant changes.
3.21.4 (2023-01-20)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.3 (2022-11-15)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.2 (2022-10-24)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.21.1 (2022-10-18)¶
REST API¶
Bugfixes¶
Fixed the fs exporter to handle the case where there are pre-existing files in the location that FileSystem attempts to export to you get a FileExistsError. #1949
Fixed content-disposition header which is used in the object storage backends. #3124
Fixed the fs exporter to handle the case where hardlink method was requested but pulp and export locations are in different partitions so can’t share the same inode. #3187
Another guardrail added around content-stages to address deadlock in a specific usecase. #3192
Fixed bug where installations with at least one pre-release plugin installed were posting to the production telemetry site instead of the developer telemetry site. #3213
Do not expose artifact digest via content-disposition header when using Azure backend. #3244
Plugin API¶
No significant changes.
3.21.0 (2022-09-08)¶
REST API¶
Features¶
Added an option for automatically creating repositories on the fly during an import procedure. The option is disabled by default. Enable it by setting the field
create_repositoriestoTruevia the REST API. #1920Content app now groups distributions in a directory structure on the landing page. #1951
Added RBAC protection to upload objects. #2362
New endpoint to list all Remote objects is now available at /pulp/api/v3/remotes/. #2530
HyperlinkRelatedFiltercan now be filtered by object types and NULL values.Repositories can now be filtered by Remotes. #2864
Introduced the
with_contentquery parameter that filters distributions by the specified content unit. #2952Add a debug log to see where is file downloaded from. #3088
Introduces anonymous telemetry data posting to https://analytics.pulpproject.org/. This is enabled by default, and can be disabled by setting the
TELEMETRYsetting toFalse. See the telemetry docs for more info on exactly what is posted along with an example. #3115
Bugfixes¶
Fixed the value of the Content-Type header returned for .xml.gz files. #2811
Improve content app performance on head requests #2924
Use published relative paths for FS Exporter. #2933
Configured aiohttp to avoid rewriting redirect URLs, as some web servers (e.g. Amazon CloudFront) can be tempermental about the encoding of the URL. #2964
Fixed inaccurate 404 error message for content app. #2977
Fixed variable referenced before assignment error in
django-admin dump-permissions. #3011Do not create telemetry TaskSchedule for production systems. #3015
Serialized orphan cleanup tasks with respect to each other to prevent them from failing. #3030
Fixed 500 error when ‘range’ header starts with a negative value for ‘on-demand’ content. #3052
Fixed bug where ‘range’ header with a start value greater than size of on-demand content would produce an incomplete response. #3054
Fixed a bug where Content-Length header value was wrong when on-demand content was requested with a Range header that has an end value greater than the size of the content. #3055
Fixed a bug in the routing logic, where generic base class viewsets were served on actual urls. #3056
Fixed a bug in import code where all objects imported would also be added to the target repository by their UUID. In case of a UUID-collision with content, unwanted content may have ended up being in the next repository version. #3064
Fixed a bug that caused the import machinery to import the same content multiple times in a row. #3075
Limited access policy reset to viewsets with a default one. This will solve 500 errors when trying to reset an access policy whose viewset name is repeated by an abstract base class. Stopped reporting on unmodified access policies when migrating. #3080
Fixed another rare deadlock for high-concurrency/overlapping-content syncs. #3111
Fixed the progress report counter for imported content units. #3113
Moved telemetry setup to the pulpcore-worker startup sequence. This will prevent orm calls before all apps are ready. #3122
Improved Documentation¶
Misc¶
Plugin API¶
Features¶
Exposed the
RepositoryResourceclass to enable plugin writers to customize the way of importing/exporting of particular repository types. Repositories should be now a part of exported resources to enable automatic creation of missing repositories. #1920Added a global access condition
has_upload_param_model_or_obj_permsto enforce permissions on the upload parameter. #2362Extended the interface of
verify_signatureas a new functiongpg_verifyto support file like objects in addition to a file path and also return thepython-gnupgverifyobject. #2930Added new field
infoto theRepositoryVersion. This will allow to store additional information for a specific version. #2998Added pulpcore.plugin.models.EncryptedTextField to plugin api. :github:`3157
Improved Documentation¶
Removals¶
Deprecated
verify_signaturein favor ofgpg_verifyfor removal in 3.25. #2930
3.20.0 (2022-06-21)¶
REST API¶
Features¶
Added a repository filter to publications. #1912
The status API endpoint now shows the python package name that provides a given plugin. #1982
Queryset scoping can be customized by the user using the new field
queryset_scopingon a ViewSet’s AccessPolicy. #2114Enabled administrators to work with a customized GnuPG home directory and keyring during the creation of a signing service. The introduced optional arguments
--gnupghomeand--keyringare available under thepulpcore-manager add-signing-servicecommand. #2476Added the setting
REDIRECT_TO_OBJECT_STORAGEto allow using cloud storage with or without redirecting urls.Added support for sftp storage via the
pulpcore.app.models.storage.PulpSFTPStorageclass. #2537Added more details to an error message that is shown when none of the allowed content checksums hashers could be used. #2550
Add contains_permission query parameter to the roles API that allows clients to get back a list of roles that have any permission in a list of permissions. #2715
Master Content endpoint,
/pulp/api/v3/content/, has a new access policy that allows any authenticated user to view content. The endpoint now scopes the content based on repositories the user can see. #2724New AccessPolicies have been added to ContentGuard, Distribution, Publication, Repository, and RepositoryVersions master ViewSets. Queryset scoping has been enabled for each ViewSet. #2725
New AccessPolicy for ContentRedirectContentGuard ViewSet has been added. #2726
Added dump-permissions management command to list deprecated permissions not yet translated into roles. This is the only way to get to this information after the 3.20 release. #2741
Add ?for_object_type query parameter to Roles API that accepts an object HREF and returns a list of roles that only contain permissions for the given object type. #2747
Add role description and permissions to group and user role serializer. #2765
Bugfixes¶
Leading and trailing whitespace characters are no longer trimmed in passwords within remotes. #2068
Fixed generation of the redirect url to the object storage #2075
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Made the API root endpoint accessible for anonymous users once again. #2340
Removed il8n from the logs written so they will always show up in English for speedy resolution of error messages. All user facing strings are still expected to be il8n. #2477
Replaced “//” with “/” in base_url when CONTENT_PATH_PREFIX is “” or “/”. #2553
Fixed does_batch method in sync pipeline to allow waiting on content that is already resolved. #2557
Fixed OOM error after uploading large chunked files. #2573
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Improved the error message when HTTP proxies reject requests from Pulp. #2654
Fix ?ordering=role on user and group role apis so that it sorts results by role name. #2703
Add options to the role_util functions to make them work the same as guardian did. #2739
Fixed a bug that disallowed administrators to create a signing service via the pulpcore-manager utility. #2798
Reduced duplicate SQL queries for
AccessPolicywhen accessing any view. #2802Fixed docs regarding the default for orphan protection time. #2810
Started showing errors when users try to export remote artifacts. #2817
Restore multiple-retry logic for PulpImport. #2854
Improved Documentation¶
Cleared out some of the paragraphs from the “Pull Request Walkthrough” section. #1852
Added a troubleshooting section that includes information on how to enable DEBUG logging. #1944
Removed some out of date references to Redmine (the previous issue tracker). We use Github Issues now. #2642
Added a note about explicitly setting
content_objectto null when assigning model-level permissions. #2758Fixed
extlinksuse in docs to be Sphinx==5.0.0 compatible. #2782Update installation instructions about “User and database configuration” for the Database setup to point to a matching Django documentation. #2877
Removals¶
Removed the group permission endpoints
api/v3/groups/:id/model_permissions/andapi/v3/groups/:id/object_permissions/. Permissions should be managed via roles exclusively. #2050Removed django-guardian from the stack. The
guardian.backends.ObjectPermissionBackendshould not be used anymore. #2051Deprecated creation hook interface was removed. Creation hook need to be registered with the view set by the plugin writer before being used. Creation hooks can no longer be added with the deprecated name
permission_assignments. #2559
Misc¶
Plugin API¶
Features¶
Plugins are required to provide the
python_package_nameas a string attribute on their subclass ofPulpPluginAppConfig. #1982Exposed the method
raise_for_unknown_content_unitswhich raisesValidationErrorfor content units that were not found in the database. #2052Plugins now have to enable default queryset scoping by setting the
queryset_scopingfield on the AccessPolicy to{"function": "scope_queryset"}.Default queryset scoping behavior can be changed by supplying a new
scope_querysetmethod.Extra queryset scoping functions can be declared on plugin ViewSets and used by setting the AccessPolicy’s
queryset_scopingfield. #2114DeclarativeArtifact now accepts a
urlsoption which permits multiple URLs to be provided for a single artifact. If multiple URLs are provided, the download stage will try each of them in turn upon encountering failures. #2175Exposed the function
pulpcore.plugin.util.verify_signaturefor verifying signatures created by signing services. #2476Added
pulpcore.plugin.content.ArtifactResponseto plugin API. Use this response to stream an artifact from the object storage if redirecting is impossible. #2537Queryset scoping is now performed when the ViewSet’s AccessPolicy field
scope_querysetis set to a function on the ViewSet.NamedModelViewSetnow has default scoping methodscope_querysetthat will scope the request off ofqueryset_filtering_required_permissionif present. If ViewSet is a master ViewSet then scoping will be performed by calling each child’s scoping method if present. #2723Content ViewSets default
scope_querysetmethod will scope based on repositories the user can see. #2724Added the ability to specify an upload for the single shot upload serializer. This allows to upload files in chunks and attach them with content in repositories without creating orphans. #2786
Added new access condition
has_required_repo_perms_on_uploadfor RBAC plugins to use to require users to specify a repository when uploading content. If not used when uploading content, non-admin users will not be able to see their uploaded content if queryset scoping is enabled. #2796
Bugfixes¶
Reworked the ordering framework to use django-filters.
Plugins should not declare filter-backends on viewsets. #2703
Improved Documentation¶
Removals¶
The
pulpcore.plugin.exceptions.MissingResourceobject has been removed. Instead let 404 errors propagate upwards for DRF to handle, or use the DRF exceptionNotFound. #1812Removed django-guardian from the stack. This includes the removal of
AutoDeleteObjPermsMixinfrom the plugin api. #2051Removed the
custom_file_objectargument topulpcore.plugin.download.BaseDownloader. Now all downloaded data will be written to a random file in the current working directory. Further customization of where downloaded data can be written to can be done through subclassing. #2137Constructor signature of DigestValidationError and SizeValidationError has changed - the “actual” and “expected” values are now required and “url” which was previously a positional argument is now a keyword argument. #2244
The pulpcore.plugin.constants.API_ROOT has been removed. Use the
V3_API_ROOTandV3_API_ROOT_NO_FRONT_SLASHsettings instead. #2556Plugins using the
SingleArtifactContentUploadSerializermust place a super call when overwritingdeferred_validate. They can only assume the existance of theArtifactin the database, after this call. #2786
Misc¶
3.19.1 (2022-07-11)¶
REST API¶
Bugfixes¶
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Fixed does_batch method in sync pipeline to allow waiting on content that is already resolved. #2557
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Improved the error message when HTTP proxies reject requests from Pulp. #2654
Restore multiple-retry logic for PulpImport. #2854
Improve content app performance on head requests #2924
Improved Documentation¶
Misc¶
Plugin API¶
No significant changes.
3.19.0 (2022-04-12)¶
REST API¶
Features¶
Content app now logs where it gets on-demand and streamed content from. #2059
Reclaim disk space can now accept [“*”] for
repo_hrefsto specify all repositories for reclaim. #2065Added a filter to allow searching for user roles by their description. #2276
Add swagger view and make OpenAPI human readable #2291
Adds a
TASK_DIAGNOSTICSsetting which will enable each task to write out diagnostic information such as memory usage of the task to a data file in/var/tmp/pulp/<task_UUID>/. This is disabled by default. #2329Added a
/pulp/api/v3/distributions/endpoint to list all distributions. #2379
Bugfixes¶
Added reason for 404 error when accessing distributions without a publication. #1910
Fixed validation order of required settings to occur before plugin settings are loaded. #1968
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Fixed two instances of Pulp not writing to the task worker’s temporary directory. #2061
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
Taught task-purge to process tasks in batches of 1000. This prevents large purges from using large amounts of memory as a result of reading all the affected Tasks into memory at once. #2215
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Added transactions around repository version operations to prevent data loss. #2268
Loosened the version-restrictions on PulpImport to only require X.Y matching. #2269
Fix a mistake in a previous migration which may have caused improperly encrypted remote fields. #2327
Fixed improper fields being listed in
RepositoryVersionrepair API. #2330Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Fixed a (rare) deadlock around bulk_update() during syncs with overlapping content. #2430
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Improved Documentation¶
Removals¶
Removed the Django UI Admin site. It was added to provide RBAC permissions management before there were APIs that could provide that. It was tech preview and now there are APIs for user and group management, along with role and permission assignment. It is being removed because the direct DB access it provides has caused some issues for users, especially since its not integrated with the validation provided by Django Rest Framework, which Pulp uses. #2374
Plugin API¶
Features¶
Exposed the
PulpRemoteUserAuthenticationclass to plugin writers. This will allow the use of remote authentication methods when building protected endpoints. #2262Added new global access conditions
has_publication_param_model_or_obj_permsandhas_repo_or_repo_ver_param_model_or_obj_permsfor RBAC checks. #2364Changed the
reusable_conditionsmodule configuration for access policies to being a list to enable plugins to add custom modules to it. #2495
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.18.32 (2023-11-14)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.18.31 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.30 (2023-10-05)¶
REST API¶
Bugfixes¶
Made sure PulpImport’s use of tar.extractall() is safe. #3323
Plugin API¶
No significant changes.
3.18.29 (2023-09-27)¶
REST API¶
Improved Documentation¶
Adds docs on recording and building graphs from the memory data saved by the
TASK_DIAGNOSTICSsetting. #2329
Misc¶
Plugin API¶
No significant changes.
3.18.28 (2023-09-20)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.27 (2023-09-06)¶
REST API¶
Bugfixes¶
Ensure the compression level is reliably set properly as per #3869. #4351
Plugin API¶
No significant changes.
3.18.26 (2023-08-23)¶
REST API¶
Bugfixes¶
Fixed bug where incorrect error message presented in relation to content-import #4294
Plugin API¶
No significant changes.
3.18.25 (2023-08-01)¶
REST API¶
Bugfixes¶
Correctly fixed pulp_rpm-export-edgecase - fix #4210 was incomplete. #4231
Plugin API¶
No significant changes.
3.18.24 (2023-07-31)¶
REST API¶
Bugfixes¶
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Plugin API¶
No significant changes.
3.18.23 (2023-07-29)¶
REST API¶
Bugfixes¶
Made reclaim space task more tolerant in the face of artifact shared between two content units. #3610
Taught pulp-import to be able to use a subset of available worker-threads. #4068
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Plugin API¶
No significant changes.
3.18.22 (2023-07-25)¶
REST API¶
Bugfixes¶
Taught repair task to be tolerant in the face of any artifact download failure. #4111
Plugin API¶
No significant changes.
3.18.21 (2023-07-19)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.20 (2023-06-14)¶
REST API¶
Bugfixes¶
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Plugin API¶
No significant changes.
3.18.19 (2023-06-06)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Plugin API¶
No significant changes.
3.18.18 (2023-05-30)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.17 (2023-04-11)¶
REST API¶
Bugfixes¶
Downloader will now attempt to keep the filename of the requested URL intact if one exists. #3715
Plugin API¶
No significant changes.
3.18.16 (2023-03-29)¶
REST API¶
Bugfixes¶
Fixed an error when raising
UnexportableArtifactException. #3313
Plugin API¶
No significant changes.
3.18.15 (2023-03-09)¶
REST API¶
Bugfixes¶
Added a
start_repository_versionparameter to the file system exporter.If specified, it will export only content units that differed between two repository versions. #3413
Plugin API¶
No significant changes.
3.18.14 (2023-02-23)¶
REST API¶
Bugfixes¶
Fixed a bug that caused the import machinery to import the same content multiple times in a row. #3075
Plugin API¶
No significant changes.
3.18.13 (2023-01-20)¶
REST API¶
Bugfixes¶
Fixed an occasional 500 error when viewing a repository version content summary while performing a content deletion task. #3299
Plugin API¶
No significant changes.
3.18.12 (2023-01-10)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.11 (2022-11-02)¶
REST API¶
Bugfixes¶
Fixed the fs exporter to handle the case where there are pre-existing files in the location that FileSystem attempts to export to you get a FileExistsError. #1949
Fixed the fs exporter to handle the case where hardlink method was requested but pulp and export locations are in different partitions so can’t share the same inode. #3187
Another step on closing the deadlock-window when syncing overlapping content. #3284
Plugin API¶
No significant changes.
3.18.10 (2022-09-14)¶
REST API¶
Bugfixes¶
Another guardrail added around content-stages to address deadlock in a specific usecase. #3192
Plugin API¶
No significant changes.
3.18.9 (2022-09-01)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.18.8 (2022-08-16)¶
REST API¶
No significant changes.
Plugin API¶
No significant changes.
3.18.7 (2022-08-15)¶
REST API¶
Bugfixes¶
Serialized orphan cleanup tasks with respect to each other to prevent them from failing. #3030
Plugin API¶
No significant changes.
3.18.6 (2022-08-03)¶
REST API¶
Bugfixes¶
Restore multiple-retry logic for PulpImport. #2854
Improve content app performance on head requests #2924
Use published relative paths for FS Exporter. #2933
Configured aiohttp to avoid rewriting redirect URLs, as some web servers (e.g. Amazon CloudFront) can be tempermental about the encoding of the URL. #2964
Improved Documentation¶
Plugin API¶
No significant changes.
3.18.5 (2022-05-10)¶
REST API¶
Bugfixes¶
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Fixed does_batch method in sync pipeline to allow waiting on content that is already resolved. #2557
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Improved the error message when HTTP proxies reject requests from Pulp. #2654
Plugin API¶
No significant changes.
3.18.4 (2022-04-12)¶
REST API¶
Bugfixes¶
Fixed two instances of Pulp not writing to the task worker’s temporary directory. #2061
Taught task-purge to process tasks in batches of 1000. This prevents large purges from using large amounts of memory as a result of reading all the affected Tasks into memory at once. #2215
Loosened the version-restrictions on PulpImport to only require X.Y matching. #2269
Fixed a (rare) deadlock around bulk_update() during syncs with overlapping content. #2430
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Plugin API¶
No significant changes.
3.18.3 (2022-03-25)¶
REST API¶
Bugfixes¶
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Plugin API¶
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.18.2 (2022-03-18)¶
REST API¶
Bugfixes¶
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Fix a mistake in a previous migration which may have caused improperly encrypted remote fields. #2327
Plugin API¶
No significant changes.
3.18.1 (2022-03-01)¶
REST API¶
Bugfixes¶
Added transactions around repository version operations to prevent data loss. #2268
Plugin API¶
No significant changes.
3.18.0 (2022-02-22)¶
REST API¶
Features¶
Added a pulpcore-manager command remove-plugin to remove a Pulp plugin. #1945
Implemented the Redis caching machinery that can be used within the synchronous context. #2003
Add a “current_task” field to workers so that you can easily see which workers are currently active. #2034
Allowed Pulp to install without Redis. #2057
Added
has_repository_obj_permsandhas_repository_model_or_obj_permsas access conditions that can be used by viewsets nested beneath repository viewsets. #2076Queryset scoping can now be disabled by changing the
DEFAULT_PERMISSION_CLASSES. #2115Specifying a different value for
DEFAULT_PERMISSION_CLASSESwill now automatically disable the permission assignment provided by thecreation_hooksportion of anAccessPolicyFromDB. #2116The Pulp API can now be rerooted using the new
API_ROOTsetting. By default it is set to/pulp/. Pulp appends the stringapi/v3/onto the value ofAPI_ROOT. #2148Added a redirecting content guard that can be employed by plugins to forward from a REST call to the content app. #2151
Added a new analyze-publication management command to facilitate debugging. #2200
Added a read-only task schedule view for configured tasks schedules.
NOTE: This feature is in tech-preview and may change in backwards incompatible ways in the future. #2204
Bugfixes¶
Fix import and export OOM error. #2072
Fixed downloader retry logic with partially written files. #2078
Fix content summary showing incorrect count after previous version deletion. #2084
Fixed issue with listing repository versions after deleting previous versions. #2085
Fixed file descriptior leak during upload. #2087
Fixed an api schema bug where both
permission_assignmentandcreation_hookswere required by theAccessPolicyserializer. #2089Fixed migration 0081 to be compatible with custom User models. #2090
Fixed PulpImport to correctly save relative to MEDIA_ROOT. #2091
Added proper logging around certain ways a task could fail. #2093
Taught PulpImport to retry in the event of a concurrency-collision on ContentArtifact. #2102
Fixed an edge case where the first (streamed) response from an repo synced as “on_demand” could be incorrect. #2119
Fixed bug where retries of partially downloaded files failed digest and size validation. #2135
Fixed the calculation of response range headers in streaming answers from the content app. #2147
Fixed potential deadlock-window in touch() path. #2157
Fixed reporting tasks being canceled before being picked up by a worker as canceled instead of failed. #2183
Return a concise message exception on 500 in case file is missing on the FS. #2187
Fixed import/export of repositories with sub-content.
An example would be the sub-repositories in pulp_rpm DistributionTrees. #2192
touch() now uses standard Django instead of raw-sql to update. #2229
Misc¶
Plugin API¶
Features¶
The
AutoAddObjPermsMixinnow calls ahandle_creation_hooksinterface on the configured DRF permission class, e.g. the defaultAccessPolicyFromDB. #2116Added a redirecting content guard that can be employed by plugins to generate preauthenticated URLs that forward from a REST call to the content app. Added the
GetOrCreateSerializerMixintoget_or_createobjects still validating them through the serializer. #2151Exposed synchronous and asynchronous caching machinery. The classes
AsyncContentCacheandSyncContentCachecan be now managed by plugin writers. #8806
Bugfixes¶
Removals¶
Deprecate the the use of
custom_file_objectparameter inBaseDownloader. #2123
Deprecations¶
The
API_ROOTconstant has been deprecated and turned into a setting. Its removal is scheduled for 3.20. Please use the setting with the same name instead. #2148The
ACCESS_POLICY_VIEWSET_NAMEattribute is no longer expected to be present on models. The RBAC machinery no longer uses this, and if present a deprecation warning will be emitted. #2209
3.17.8 (2022-05-10)¶
REST API¶
Bugfixes¶
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Fixed does_batch method in sync pipeline to allow waiting on content that is already resolved. #2557
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Improved the error message when HTTP proxies reject requests from Pulp. #2654
Plugin API¶
No significant changes.
3.17.7 (2022-04-12)¶
REST API¶
Bugfixes¶
Fixed two instances of Pulp not writing to the task worker’s temporary directory. #2061
Taught task-purge to process tasks in batches of 1000. This prevents large purges from using large amounts of memory as a result of reading all the affected Tasks into memory at once. #2215
Loosened the version-restrictions on PulpImport to only require X.Y matching. #2269
Fixed a (rare) deadlock around bulk_update() during syncs with overlapping content. #2430
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Plugin API¶
No significant changes.
3.17.6 (2022-03-25)¶
REST API¶
Bugfixes¶
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Plugin API¶
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.17.5 (2022-03-18)¶
REST API¶
Bugfixes¶
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
Taught PulpImport to retry in the event of a concurrency-collision on ContentArtifact. #2102
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Fix a mistake in a previous migration which may have caused improperly encrypted remote fields. #2327
Plugin API¶
No significant changes.
3.17.4 (2022-03-01)¶
REST API¶
Bugfixes¶
Fix import and export OOM error. #2072
Fixed downloader retry logic with partially written files. #2078
Fix content summary showing incorrect count after previous version deletion. #2084
Fixed issue with listing repository versions after deleting previous versions. #2085
Fixed file descriptior leak during upload. #2087
Added proper logging around certain ways a task could fail. #2093
Make checksum mismatches a retryable error. #2094
Fixed an edge case where the first (streamed) response from an repo synced as “on_demand” could be incorrect. #2119
Fixed bug where retries of partially downloaded files failed digest and size validation. #2135
Fixed the calculation of response range headers in streaming answers from the content app. #2147
Fixed potential deadlock-window in touch() path. #2157
Fixed reporting tasks being canceled before being picked up by a worker as canceled instead of failed. #2183
Fixed import/export of repositories with sub-content.
An example would be the sub-repositories in pulp_rpm DistributionTrees. #2192
touch() now uses standard Django instead of raw-sql to update. #2229
Added transactions around repository version operations to prevent data loss. #2268
Plugin API¶
No significant changes.
3.17.3 (2022-01-12)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Exposed adjust_roles in the plugin api. (backported from #9665) #9668
3.17.2 (2022-01-06)¶
REST API¶
Bugfixes¶
Fixed PulpImport to correctly save relative to MEDIA_ROOT. (backported from #9660) #9664
Plugin API¶
No significant changes.
3.17.1 (2021-12-21)¶
REST API¶
Bugfixes¶
Fixed migration 0081 to be compatible with custom User models. #9654
Plugin API¶
No significant changes.
3.17.0 (2021-12-14)¶
REST API¶
Features¶
Added a
/tasks/purge/API to do bulk-deletion of old tasks.Over time, the database can fill with task-records. This API allows an installation to bulk-remove records based on their completion timestamps.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #8554
Added a role model to support RBAC and the utility functions
assign_roleandremove_role.The field
permissions_assignmentof access policies has been renamed tocreation_hooks. A compatibility patch has been added to be removed with pulpcore=3.20.The
permissionsargument tocreation_hookshas been deprecated to be removed with pulpcore=3.20. #9411Added views to assign model and object level roles to users and groups. #9413
Rewrote existing access policies on viewsets to use roles. #9415
Added validation to prevent credentials in remote urls. Also added data migration to move credentials out of remote url and into remote username/password fields for existing remotes. #9459
Reworked RBAC Content Guards to now use roles. Added new endpoints
{list, add, remove}_rolesandmy_permissionsto the RBAC content guard viewset. #9498Content-type and Content-disposition headers are now sent in the AzureStorage.url. #9518
SigningService scripts can now access the public key fingerprint using the
PULP_SIGNING_KEY_FINGERPRINTenvironment variable. This allows for more generic scripts, that do not need to “guess” (hardcode) what key they should use. #9532Added object specific endpoints
{list,add}_roles,remove_rolesandmy_permissionsto tasks and groups viewsets. #9604Added a
resetendpoint to the access policy viewset to revert to the provided default uncustomized access policy. #9606
Bugfixes¶
PulpImporter now unpacks into the task-worker’s working directory rather than /tmp. Unpacking large files into /tmp could cause the operation to fail, or even cause stability issues for Pulp instance, due to running /tmp out of space. #8610
Missing worker records are now kept in the database for seven days allowing time for post-mortem analysis of them. The user-facing data in the status API remains unmodified. #8988
Made Pulp to be fault-tolerant to Redis server connection issues. #8997
Cache is now properly invalidated after reclaim disk task. #9215
Fixed bug where the content app would stop working after a brief loss of connection to the database. #9276
Improved messaging around timeout requests. #9301
Updated the distribution validation to properly handle the use of
repository/repository_version/publication. #9434Fixed issue with listing repository versions while running orphan cleanup task. #9481
Fixed erroneous ordering filters from appearing in HTML views and causing 500 errors when used. #9496
Fixed bug where Artifacts were being downloaded even if they were already saved in Pulp. #9542
Fixed a bug in pulpcore-worker, where wakeup and cancel signals could be lost due to a race condition. #9549
Fixed bug where chunked uploads were being assembled in /tmp. #9550
Created a proxy model for Groups to allow using creation_hooks with them. #9588
Fixed permission errors on artifact retrieval from object storage when redis caching is enabled. #9595
Improved Documentation¶
Removals¶
Misc¶
Plugin API¶
Features¶
Added
get_objects_for_userto support queryset filtering by roles. Added hooks inAutoAddObjPermsMixinto support auto-assignment of roles.Changed the lookup for creation hooks so hooks need to be registered in
REGISTERED_CREATION_HOOKSon the model to be used. The signature for creation hooks that are registered must match the exploded version of the dict parameters from the access policy. Unregistered creation hooks are deprecated and support will be dropped in pulpcore 3.20. #9411Made RepositoryAddRemoveContentSerializer available for plugin writers. #9504
Added ability to pass headers through the AzureStorage.url. #9518
Remote.get_remote_artifact_urlnow accepts arequestparameter. #9554Added
initialize_new_versionfunction toRepositorymodel. #9579DownloaderFactory.user_agent() method is now available if plugin needs to generate User-Agent header value to use in their custom (subclasssed) downloader factory. #9591
Added ability to use a custom download factory. Remote.get_downloader now accepts a download_factory parameter. #9592
Handler._serve_content_artifactmethod accepts new positional argumentrequest. #9595Added Group model to plugin api. Added
RolesMixinto for viewsets to allow managing object roles based on permissions. #9604Added new async sign method
asignto theSigningServicemodel. #9615SigningService.signandSigningService.asignnow accepts aenv_varparameter that makes it possible to pass environment variables to the signing script. #9621
Bugfixes¶
Include additional information about which AccessPolicy is using deprecated policy features. #9608
3.16.24 (2023-10-30)¶
REST API¶
Bugfixes¶
Resolved a sync-time performance regression. #4591
Plugin API¶
No significant changes.
3.16.23 (2023-10-16)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.22 (2023-10-05)¶
REST API¶
Bugfixes¶
Made sure PulpImport’s use of tar.extractall() is safe. #3323
Plugin API¶
No significant changes.
3.16.21 (2023-09-27)¶
REST API¶
Improved Documentation¶
Adds docs on recording and building graphs from the memory data saved by the
TASK_DIAGNOSTICSsetting. #2329
Misc¶
Plugin API¶
No significant changes.
3.16.20 (2023-09-20)¶
REST API¶
Bugfixes¶
Removed compression from exports (using gzip level 0). For most users of export functionality it seems to be a poor tradeoff. #4434
Plugin API¶
No significant changes.
3.16.19 (2023-09-13)¶
REST API¶
Bugfixes¶
Taught PulpImport to be more robust in the face of previous failed attempts. #3737
Exports now use gzip compression level 1 rather than compression level 9. Exported archives will now be slightly larger, but exports should be much faster. This is considered to be a more optimal balance of space/time for the export operation. #3869
Improved the performance when looking up content for repository versions. #3969
Taught the Artifact.json of an export to hold minimum-unique-set of Artifact entries.
In highly-duplicated-content export scenarios, this can mean a significant decrease in export-size, and significant improvement in import-performance. #4159
Fix a subtle export bug introduced from the optimizations in #4159. #4210
Correctly fixed pulp_rpm-export-edgecase - fix #4210 was incomplete. #4231
Ensure the compression level is reliably set properly as per #3869. #4351
Ensure non-chunked exports also use gzip
compressionlevel=1#4411
Plugin API¶
No significant changes.
3.16.18 (2023-08-01)¶
REST API¶
Bugfixes¶
Updated the downloader’s fetch method to comply with Python 3.11. #4107
Plugin API¶
No significant changes.
3.16.17 (2023-04-11)¶
REST API¶
Bugfixes¶
Downloader will now attempt to keep the filename of the requested URL intact if one exists. #3715
Plugin API¶
No significant changes.
3.16.16 (2023-02-23)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.15 (2022-11-02)¶
REST API¶
Bugfixes¶
Fixed the fs exporter to handle the case where there are pre-existing files in the location that FileSystem attempts to export to you get a FileExistsError. #1949
Fixed the fs exporter to handle the case where hardlink method was requested but pulp and export locations are in different partitions so can’t share the same inode. #3187
Another step on closing the deadlock-window when syncing overlapping content. #3284
Plugin API¶
No significant changes.
3.16.14 (2022-09-13)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.13 (2022-09-01)¶
REST API¶
Bugfixes¶
Fixed another rare deadlock for high-concurrency/overlapping-content syncs. #3111
Plugin API¶
No significant changes.
3.16.12 (2022-08-05)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.11 (2022-07-14)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.10 (2022-06-16)¶
REST API¶
Bugfixes¶
Restore multiple-retry logic for PulpImport. #2854
Plugin API¶
No significant changes.
3.16.9 (2022-06-15)¶
REST API¶
Bugfixes¶
Started showing errors when users try to export remote artifacts. #2817
Misc¶
Plugin API¶
No significant changes.
3.16.8 (2022-05-10)¶
REST API¶
Bugfixes¶
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Fixed does_batch method in sync pipeline to allow waiting on content that is already resolved. #2557
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Improved the error message when HTTP proxies reject requests from Pulp. #2654
Plugin API¶
No significant changes.
3.16.7 (2022-04-12)¶
REST API¶
Bugfixes¶
Fixed two instances of Pulp not writing to the task worker’s temporary directory. #2061
Fixed file descriptior leak during upload. #2087
Fixed a bug in pulpcore-worker, where wakeup and cancel signals could be lost due to a race condition. #2144
Loosened the version-restrictions on PulpImport to only require X.Y matching. #2269
Fixed a (rare) deadlock around bulk_update() during syncs with overlapping content. #2430
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Plugin API¶
No significant changes.
3.16.6 (2022-03-25)¶
REST API¶
Bugfixes¶
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Fixed secure proxy support by updating aiohttp version to ~=3.8.1. #2423
Plugin API¶
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.16.5 (2022-03-17)¶
REST API¶
Bugfixes¶
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
Taught PulpImport to retry in the event of a concurrency-collision on ContentArtifact. #2102
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Fix a mistake in a previous migration which may have caused improperly encrypted remote fields. #2327
Plugin API¶
No significant changes.
3.16.4 (2022-03-01)¶
REST API¶
Bugfixes¶
Fix content summary showing incorrect count after previous version deletion. #2084
Fixed issue with listing repository versions after deleting previous versions. #2085
Fixed potential deadlock-window in touch() path. #2157
Fixed import/export of repositories with sub-content.
An example would be the sub-repositories in pulp_rpm DistributionTrees. #2192
touch() now uses standard Django instead of raw-sql to update. #2229
PulpImporter now unpacks into the task-worker’s working directory rather than /tmp. Unpacking large files into /tmp could cause the operation to fail, or even cause stability issues for Pulp instance, due to running /tmp out of space. #2247
Added transactions around repository version operations to prevent data loss. #2268
Plugin API¶
No significant changes.
3.16.3 (2022-02-08)¶
REST API¶
Bugfixes¶
Fix import and export OOM error. #2072
Fixed downloader retry logic with partially written files. #2078
Fixed bug where retries of partially downloaded files failed digest and size validation. #2135
Fixed the calculation of response range headers in streaming answers from the content app. #2147
Improved messaging around timeout requests. #2169
Fixed reporting tasks being canceled before being picked up by a worker as canceled instead of failed. #2183
Misc¶
Plugin API¶
No significant changes.
3.16.2 (2022-01-07)¶
REST API¶
Bugfixes¶
Fixed PulpImport to correctly save relative to MEDIA_ROOT. (backported from #9660) #9663
Plugin API¶
No significant changes.
3.16.1 (2021-12-02)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.16.0 (2021-10-05)¶
REST API¶
Features¶
Bugfixes¶
Ordered several ContentStages paths to fix deadlocks in high-concurrency scenarios. #8750
Fixed a bug where
pulpcore-contentdecompressed data while incorrectly advertising to clients it was still compressed via theContent-Encoding: gzipheader. #9213Changed the pulpcore-worker to mark abandoned tasks as “failed” instead of “canceled”. #9247
Fixed the repository modify endpoint performance problems. #9266
RBACContentGuardassign/remove permission endpoints now properly return 201 instead of 200 #9314Fixed bug where some Openshift environments could not start workers due to a strange Python runtime import issue. #9338
PATCH/PUT/DELETE calls for the ACS are asynchronous and trigger a task. #9374
Fixed update call for the ACS so paths are not silenty removed when other fields are being updated. #9376
Fixed an issue where on_demand content might not be downloaded properly if the remote URL was changed (even if re-synced). #9395
Fixed a bug, where natural key calculations on content performed superfluous database calls. #9409
Ensured that with the removal of ACS its’ hidden repositories are removed as well. #9417
Taught a remote-artifact error path to not assume ‘filename’ was valid for all content. #9427
Taught several more codepaths to order-before-update to avoid deadlocks. #9441
Improved Documentation¶
Added an architecture diagram to the components page. #7692
Fixed a note saying where to find versioning details. #8859
Removed deprecated uses of
MEDIA_ROOT. #9100Updated ACS docs to use CLI commands. #9251
Document Azure storage needs to set
MEDIA_ROOT#9428Corrected a fact that Redis is needed by the tasking system in the installation section. #9436
Removals¶
Misc¶
Plugin API¶
Features¶
Added optional stage for Alternate Content Source support. #8748
AlternateContentSourcehas a new class variableREMOTE_TYPESthat it will use to validate the type of remote set on the ACS. #9375Added
pulpcore.plugin.viewset.TaskGroupResponsewhich can be used to return a reference to a task group created in a viewset. Addedpulpcore.plugin.serializers.TaskGroupResponseSerializerwhich can be used to indicate the serializer response format of viewsets that will useTaskGroupResponsesimilar to howAsyncOperationResponseSerializeris used. #9380Added the
pulpcore.plugin.tasking.general_multi_deletethat deletes a list of model instances in a transaction. #9417Exposed tasks
general_create,general_create_from_temp_file,general_delete,general_update,orphan_cleanup, andreclaim_spacein the plugin api. #9418ALLOW_SHARED_TASK_RESOURCES is now enabled by default. If all goes smoothly, this will become permanent and the setting will be removed in the next release. #9474
Bugfixes¶
Removals¶
Removed the deprecated
reserved_resources_record__resourcefilter for Task. Usereserved_resources_record__containsinstead. #9157Removed drf-access-policy workaround for condition/condition_expession. #9163
Removed ACS path validation. Plugins should now define
validate_pathson their ACS serializer to validate paths. #9340Renamed
TaskGroupResponsetoTaskGroupOperationResponseandTaskGroupResponseSerializertoTaskGroupOperationResponseSerializerin order to avoid conflicts with responses from task groups endpoints. #9425The resources argument of dispatch() has been removed. exclusive_resources and shared_resources should be used instead. #9477
ContentSaver._pre_save() and ContentSaver._post_save() must now be implemented as synchronous functions rather than coroutines. #9478
3.15.9 (2022-06-28)¶
REST API¶
Bugfixes¶
Restore multiple-retry logic for PulpImport. #2854
Misc¶
Plugin API¶
No significant changes.
3.15.8 (2022-04-12)¶
REST API¶
Bugfixes¶
Fixed file descriptior leak during upload. #2087
Fixed a bug in pulpcore-worker, where wakeup and cancel signals could be lost due to a race condition. #2144
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Changed the pulpcore-worker to mark abandoned tasks as “failed” instead of “canceled”. #2532
Plugin API¶
No significant changes.
3.15.7 (2022-03-25)¶
REST API¶
Bugfixes¶
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Plugin API¶
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.15.6 (2022-03-22)¶
REST API¶
Bugfixes¶
Fix a mistake in a previous migration which may have caused improperly encrypted remote fields. #2327
Plugin API¶
No significant changes.
3.15.5 (2022-03-15)¶
REST API¶
Bugfixes¶
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Fix content summary showing incorrect count after previous version deletion. #2084
Fixed issue with listing repository versions after deleting previous versions. #2085
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
Taught PulpImport to retry in the event of a concurrency-collision on ContentArtifact. #2102
Fixed potential deadlock-window in touch() path. #2157
Fixed reporting tasks being canceled before being picked up by a worker as canceled instead of failed. #2183
Fixed import/export of repositories with sub-content.
An example would be the sub-repositories in pulp_rpm DistributionTrees. #2192
touch() now uses standard Django instead of raw-sql to update. #2229
PulpImporter now unpacks into the task-worker’s working directory rather than /tmp. Unpacking large files into /tmp could cause the operation to fail, or even cause stability issues for Pulp instance, due to running /tmp out of space. #2247
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Added transactions around repository version operations to prevent data loss. #2268
Fixed bug where the content app would stop working after a brief loss of connection to the database. #2293
Plugin API¶
No significant changes.
3.15.4 (2022-01-28)¶
REST API¶
Bugfixes¶
Fixed downloader retry logic with partially written files. #2078
Fixed bug where retries of partially downloaded files failed digest and size validation. #2135
Fixed the calculation of response range headers in streaming answers from the content app. #2147
Improved messaging around timeout requests. #2169
Misc¶
Plugin API¶
No significant changes.
3.15.3 (2021-11-30)¶
REST API¶
Bugfixes¶
Fixed bug where Artifacts were being downloaded even if they were already saved in Pulp. (backported from #9542) #9584
Plugin API¶
No significant changes.
3.15.2 (2021-09-02)¶
REST API¶
Bugfixes¶
Fixed bug where some Openshift environments could not start workers due to a strange Python runtime import issue. (backported from #9338) #9342
Plugin API¶
No significant changes.
3.15.1 (2021-08-31)¶
REST API¶
Bugfixes¶
RBACContentGuardassign/remove permission endpoints now properly return 201 instead of 200 (backported from #9314) #9323
Plugin API¶
Bugfixes¶
Set the default widget type to
JSONWidgetforJSONFieldsfor Model Resources to fix django-import-export bug wheredjango.db.models.JSONFieldsweren’t properly handled. (backported from #9307) #9324
3.15.0 (2021-08-26)¶
REST API¶
Features¶
Added encryption in the database for
Remotefieldsusername,password,proxy_username,proxy_password, andclient_key. #8192Added feature to reclaim disk space for a list of repositories. #8459
Added
methodfield to filesystem exporters to customize how they export files. Users can now export files by writing them to the filesystem, using hardlinks, or using symlinks. #8695Changed orphan cleanup task to be a non-blocking task that can be run at any time. Added a
ORPHAN_PROTECTION_TIMEsetting that can be configured for how long orphan Content and Artifacts are kept before becoming candidates for deletion by the orphan cleanup task. #8824Added a
/v3/exporters/core/filesystem/endpoint for exporting publications or repository versions to the filesystem. #8860Added a periodical cleanup to the pulpcore-worker class to keep the Worker table clean. #8931
Added new content guard that uses RBAC policies to protect content #8940
Added authentication to the content app. #8951
A new setting
ALLOW_SHARED_TASK_RESOURCESwas temporarily added to allow plugins to use specific resources concurrently, during task execution. It defaults toFalse. It will switch toTruewith 3.16 and will eventually be removed. #9148
Bugfixes¶
In stages-pipeline and new-version sanity-checks, added full error-info on path-problems. #8133
Improved disk usage during the synchronization. #8295
Fixed an internal server error that was raised when a user provided invalid parameters while assigning new permissions to an object. #8500
Fixed a bug, where new tasks were assigned to dead workers. #8779
Fixed bug where content app would not respond to
RangeHTTP Header in requests whenremote.policywas eitheron_demandorstreamed. For example this request is used by Anaconda clients. #8865Unpublished content can no longer be accessed from content app if publication based-plugin has defined their distributions as publication serving #8870
Fixed a bug that caused a serializer to ignore form data for
pulp_labels. #8954Fixed inability for users to disable RBAC at the settings level by changing the
DEFAULT_PERMISSION_CLASSESlike any user configuring a DRF project expects to. #8974Fixed signal handling to properly kill a task when double ctrl-c is used to shut down a worker fast. #8986
Added an attempt to cancel a task if a worker needed to abort it on graceful shutdown. #8987
Fixed a bug where on-demand downloads would fill up
/var/run/by not deleting downloaded files. #9000Fixed a regression preventing syncs from file:// urls. #9003
Removed ambiguity from the OpenAPI schema for Exports. The exported_resources are now a list of URI strings. #9008
Use proxy auth from Remote config to download content from a remote repository. #9024
Fixed the behavior of setting “repository” on a distribution for publication-based plugins. #9039
Set Redis connection information in status to null unless it’s used. Redis is needed for RQ tasking or content caching. #9070
Fixed server error when accessing invalid files from content app base directory #9074
Fixed improper validation of remotes’ URLs. #9080
Artifacts are now being properly updated for Content after switching from ‘on_demand’ to ‘immediate’. #9101
Made all database queries run serially using a single connection to the database. #9129
Move files to artifact storage only when they originate from WORKING_DIRECTORY. Copy files from all other sources. #9146
Content app now properly sets Content-Type header for artifacts being served from S3 #9216
Fixed repository sync performance regression introduced in pulpcore 3.14. #9243
Stop using insecure hash function blake2s for calculating 64 bit lock identifier from uuid. #9249
Fixed another occurence of the HTTP 500 error and connection already closed in the logs while accessing content. #9275
Removals¶
Deprecations¶
The traditional tasking system (formerly the default in
pulpcore<=3.13) is deprecated and will be removed inpulpcore==3.16. If you are using theUSE_NEW_WORKER_TYPE=Falsethat will no longer give you the traditional tasking system starting withpulpcore==3.16. #9159
Misc¶
Plugin API¶
Features¶
Content model has a new boolean class constant
PROTECTED_FROM_RECLAIMfor plugins to enable the reclaim disk space feature provided by core. #8459Added endpoints for managing Alternate Content Sources. #8607
Orphan cleanup task has a new optional parameter
orphan_protection_timethat decides for how long Pulp will hold orphan Content and Artifacts before they become candidates for deletion for this particular orphan cleanup task. #8824Distribution model has a new boolean class variable
SERVE_FROM_PUBLICATIONfor plugins to declare whether their distributions serve from publications or directly from repository versions #8870The settings file switched
DEFAULT_PERMISSION_CLASSESto useAccessPolicyFromDBinstead ofIsAdminUserwith a fallback to a behavior ofIsAdminUser. With this feature plugin writers no longer need to declarepermission_classeson their Views or Viewsets to useAccessPolicyFromDB. #8974Upgraded django from 2.2 to 3.2. #9018
pulpcore.plugin.models.ProgressReport now has async interfaces: asave(), aincrease_by(), aincrement(), __aenter__(), _aexit__(). Plugins should switch to the async interfaces in their Stages. pulpcore.plugin.sync.sync_to_async_iterator is a utility method to synchronize the database queries generated when a QuerySet is iterated. #9129
Added
shared_resourcesto thedispatchcall, so tasks can run concurrently if they need overlapping resources for read only. #9148Added
touchto Artifact and Content query sets for bulk operation. #9234Added ContentManager to the plugin API - all subclasses of Content that add their own custom manager should have the manager subclass ContentManager. #9269
Bugfixes¶
Added kwarg to RemoteArtifactSaver init to allow enabling handling of rare error edge-case.
fix_mismatched_remote_artifacts=True enables workaround for a failure-scenario that (so far) is only encountered by pulp_rpm. Current behavior is the default. #8133
Removals¶
Removed the
pulpcore.plugin.viewsets.NewDistributionFilter. Instead usepulpcore.plugin.viewsets.DistributionFilter. #8479Removed
FilesystemExporterSerializerandPublicationExportSerializerfrom the plugin api. Filesystem exports are now handled by pulpcore. #8860The
pulpcore.plugin.download.http_giveupmethod has been removed from the plugin API. Plugins used to have to use this to wrap the_runmethod defined on subclasses ofHttpDownloader, but starting with pulpcore 3.14 the backoff is implemented directly in theHttpDownloader.run()method which subclasses do not override. Due topulpcoreimplementing it, it is no longer needed or available for plugins to use. #8913
Deprecations¶
ContentSaver._pre_save() and ContentSaver._post_save() hooks are no longer coroutines. They should be implemented as synchronous functions. #9129
Deprecate the compatibility layer for access policies. As of pulpcore 3.16, all plugins should properly use the “condition” and “condition_expression” fields in the access policy statements. #9160
Deprecate the
resourcesargument ofdispatchin favor ofexclusive_resourcesandshared_resources. #9257
Misc¶
3.14.19 (2023-02-09)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.18 (2022-07-14)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.17 (2022-05-09)¶
REST API¶
Bugfixes¶
Loosened the version-restrictions on PulpImport to only require X.Y matching. #2269
Taught PulpImport to stream imports rather than reading files into memory in one chunk.
This largely alleviates the memory-pressure that results from importing multiple large repositories in parallel. #2307
Ensure downloader resets file on retry. #2576
Taught PulpImport to retry more than once in the event of creation-collisions.
This fixes a rare import-failure during high-concurrency, high-content-overlap imports. #2589
Plugin API¶
No significant changes.
3.14.16 (2022-04-12)¶
REST API¶
Bugfixes¶
Fixed two instances of Pulp not writing to the task worker’s temporary directory. #2061
Fixed a (rare) deadlock around bulk_update() during syncs with overlapping content. #2430
Fixed a bug where notifications to workers may go unnoticed. This may lead to idle workers while there are tasks waiting. #2506
Plugin API¶
No significant changes.
3.14.15 (2022-03-25)¶
REST API¶
Bugfixes¶
Fix delete repository version causing “duplicate key value violates unique constraint” error. #2047
Reduced memory usage during tasks like sync by holding fewer objects in-memory unnecessarily. #2069
This fix prevents the lost track of a content removed version when deleting a repository version that deletes a content that is added back in the subsequent version, but deleted again in a later version. #2267
Fixes duplicate key error
Key (content_artifact_id, remote_id)when creatingRemoteArtifactsduring syncs in pulp_container and possibly other plugins. #2381Declared proper dependency on user model in migration 0040. #2403
Fixed a rare deadlock when sync’ing overlapping content in high-concurrency envs. #2420
Plugin API¶
Bugfixes¶
Adjusted the default size of the queues between pipelines to be 1 instead of 1000. The batchers in the stage will still accumulate up to 500 (by default) items so batching is still in-effect there where it matters. #2069
3.14.14 (2022-03-10)¶
REST API¶
Bugfixes¶
Fixed migration 0064_add_new_style_task_columns to purge extraneous ReservedResource and TaskReservedResource entries, which could block sync and publish tasks post-upgrade.
Also taught the migration to bulk-update the Task changes. In large installations, this should have a positive impact on the time it takes to apply the migration. #2101
Plugin API¶
No significant changes.
3.14.13 (2022-03-08)¶
REST API¶
Bugfixes¶
Taught PulpImport to retry in the event of a concurrency-collision on ContentArtifact. #2102
Fixed import/export of repositories with sub-content.
An example would be the sub-repositories in pulp_rpm DistributionTrees. #2192
touch() now uses standard Django instead of raw-sql to update. #2229
PulpImporter now unpacks into the task-worker’s working directory rather than /tmp. Unpacking large files into /tmp could cause the operation to fail, or even cause stability issues for Pulp instance, due to running /tmp out of space. #2247
3.14.12 (2022-02-11)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.11 (2022-01-27)¶
REST API¶
Bugfixes¶
Fix import and export OOM error. #2072
Fixed downloader retry logic with partially written files. #2078
Fix content summary showing incorrect count after previous version deletion. #2084
Fixed issue with listing repository versions after deleting previous versions. #2085
Fixed file descriptior leak during upload. #2087
Added proper logging around certain ways a task could fail. #2093
Make checksum mismatches a retryable error. #2094
Fixed an edge case where the first (streamed) response from an repo synced as “on_demand” could be incorrect. #2119
Fixed bug where retries of partially downloaded files failed digest and size validation. #2135
Fixed a bug in pulpcore-worker, where wakeup and cancel signals could be lost due to a race condition. #2144
Fixed the calculation of response range headers in streaming answers from the content app. #2147
Plugin API¶
No significant changes.
3.14.10 (2022-01-07)¶
REST API¶
Bugfixes¶
Fixed PulpImport to correctly save relative to MEDIA_ROOT. (backported from #9660) #9662
Plugin API¶
No significant changes.
3.14.9 (2021-11-05)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.8 (2021-10-06)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.7 (2021-09-29)¶
REST API¶
Bugfixes¶
Added a periodical cleanup to the pulpcore-worker class to keep the Worker table clean. (backported from #8931) #9462
Ordered several ContentStages paths to fix deadlocks in high-concurrency scenarios. (backported from #8750) #9379
Fixed an issue where on_demand content might not be downloaded properly if the remote URL was changed (even if re-synced). (backported from #9395) #9400
Fixed the repository modify endpoint performance problems. (backported from #9266) #9401
Taught a remote-artifact error path to not assume ‘filename’ was valid for all content. (backported from #9427) #9440
Taught several more codepaths to order-before-update to avoid deadlocks. (backported from #9441) #9445
Changed the pulpcore-worker to mark abandoned tasks as “failed” instead of “canceled”. (backported from #9247) #9453
Plugin API¶
No significant changes.
3.14.6 (2021-09-02)¶
REST API¶
Bugfixes¶
Stop using insecure hash function blake2s for calculating 64 bit lock identifier from uuid. (backported from #9249) #9288
Fixed a bug where
pulpcore-contentdecompressed data while incorrectly advertising to clients it was still compressed via theContent-Encoding: gzipheader. (backported from #9213) #9325Fixed bug where some Openshift environments could not start workers due to a strange Python runtime import issue. (backported from #9338) #9339
Plugin API¶
No significant changes.
3.14.5 (2021-08-24)¶
REST API¶
Bugfixes¶
Content app now properly sets Content-Type header for artifacts being served from S3 (backported from #9216) #9244
Artifacts are now being properly updated for Content after switching from ‘on_demand’ to ‘immediate’. (backported from #9101) #9261
Fixed repository sync performance regression introduced in pulpcore 3.14. (backported from #9243) #9264
Fixed another occurence of the HTTP 500 error and connection already closed in the logs while accessing content. (backported from #9275) #9282
Misc¶
Plugin API¶
Misc¶
3.14.4 (2021-08-10)¶
REST API¶
Bugfixes¶
Unpublished content can no longer be accessed from content app if publication based-plugin has defined their distributions as publication serving (backported from #8870) #9126
In stages-pipeline and new-version sanity-checks, added full error-info on path-problems. (backported from #8133) #9130
Move files to artifact storage only when they originate from WORKING_DIRECTORY. Copy files from all other sources. (backported from #9146) #9202
Misc¶
Plugin API¶
Features¶
Distribution model has a new boolean class variable
SERVE_FROM_PUBLICATIONfor plugins to declare whether their distributions serve from publications or directly from repository versions (backported from #8870) #9126
Bugfixes¶
Added kwarg to RemoteArtifactSaver init to allow enabling handling of rare error edge-case.
fix_mismatched_remote_artifacts=True enables workaround for a failure-scenario that (so far) is only encountered by pulp_rpm. Current behavior is the default. (backported from #8133) #9130
3.14.3 (2021-07-23)¶
REST API¶
Bugfixes¶
Fixed improper validation of remotes’ URLs. (backported from #9080) #9083
Set Redis connection information in status to null unless it’s used. Redis is needed for RQ tasking or content caching. (backported from #9070) #9085
Fixed signal handling to properly kill a task when double ctrl-c is used to shut down a worker fast. (backported from #8986) #9086
Improved disk usage during the synchronization. (backported from #8295) #9103
Fixed a bug where on-demand downloads would fill up
/var/run/by not deleting downloaded files. (backported from #9000) #9110Fixed a bug, where new tasks were assigned to dead workers. (backported from #8779) #9116
Plugin API¶
No significant changes.
3.14.2 (2021-07-13)¶
REST API¶
Bugfixes¶
Fixed bug where content app would not respond to
RangeHTTP Header in requests whenremote.policywas eitheron_demandorstreamed. For example this request is used by Anaconda clients. (backported from #8865) #9057Fixed a bug that caused a serializer to ignore form data for
pulp_labels. (backported from #8954) #9058Fixed the behavior of setting “repository” on a distribution for publication-based plugins. (backported from #9039) #9059
Use proxy auth from Remote config to download content from a remote repository. (backported from #9024) #9068
Fixed server error when accessing invalid files from content app base directory (backported from #9074) #9077
Misc¶
Plugin API¶
No significant changes.
3.14.1 (2021-07-07)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.14.0 (2021-07-01)¶
REST API¶
Features¶
Introduce new worker style. (tech-preview) #8501
Added new endpoint
/pulp/api/v3/orphans/cleanup/. When called withPOSTand no parameters it is equivalent to callingDELETE /pulp/api/v3/orphans/. Additionally the optional parametercontent_hrefscan be specified and must contain a list of content hrefs. Whencontent_hrefsis specified, only those content units will be considered to be removed by orphan cleanup. #8658Content app responses are now smartly cached in Redis. #8805
Downloads from remote sources will now be retried on more kinds of errors, such as HTTP 500 or socket errors. #8881
Add a correlation id filter to the task list endpoint. #8891
Where before
download_concurrencywould previously be set to a default value upon creation, it will now be set NULL (but a default value will still be used). #8897Added graceful shutdown to pulpcore workers. #8930
Activate the new task worker type by default.
Warning
If you intend to stick with the old tasking system, you should configure the
USE_NEW_WORKER_TYPEsetting to false before upgrade
Bugfixes¶
Fixed race condition where a task could clean up reserved resources shared with another task. #8637
Altered redirect URL escaping, preventing invalidation of signed URLs for artifacts using cloud storage. #8670
Add an update row lock on in task dispatching for
ReservedResourceto prevent a race where an object was deleted that was supposed to be reused. This prevents a condition where tasks ended up in waiting state forever. #8708Retry downloads on
ClientConnectorSSLError, which appears to be spuriously returned by some CDNs. #8867Fixed OpenAPI schema tag generation for resources that are nested more than 2 levels.
This change is most evident in client libraries generated from the OpenAPI schema.
Prior to this change, the API client for a resource located at /api/v3/pulp/exporters/core/pulp/<uuid>/exports/ was named ExportersCoreExportsApi.
After this change, the API client for a resource located at /api/v3/pulp/exporters/core/pulp/<uuid>/exports/ is named ExportersPulpExportsApi. #8868
Fixed request schema for
/pulp/api/v3/repair/, which did identify any arguments. This also fixes the bindings. #8869Update default access policies in the database if they were unmodified by the administrator. #8883
Pinning to psycopg2 < 2.9 as psycopg 2.9 doesn’t work with django 2.2. More info at https://github.com/django/django/commit/837ffcfa681d0f65f444d881ee3d69aec23770be. #8926
Fixed bug where artifacts and content were not always saved in Pulp with each on_demand request serviced by content app. #8980
Improved Documentation¶
Fixed a number of link-problems in the installation/ section of docs. #6837
Added a troubleshooting section to the docs explaining how to find stuck tasks. #8774
Moved existing basic auth docs to a new top-level section named Authentication. #8800
Moved
Webserver Authenticationdocs under the top-levelAuthenticationsection. #8801Provide instructions to use Keycloak authenication using Python Social Aauth #8803
Updated the docs.pulpproject.org to provide some immediate direction for better user orientation. #8946
Separated hardware and Filesystem information from the Architecture section and added them to the Installation section. #8947
Added sub-headings and simplified language of Pulp concept section. #8949
Deprecations¶
Deprecated the
DELETE /pulp/api/v3/orphans/call. Instead use thePOST /pulp/api/v3/orphans/cleanup/call. #8876
Misc¶
Plugin API¶
Features¶
Added the
pulpcore.plugin.viewsets.DistributionFilter. This should be used instead ofpulpcore.plugin.viewsets.NewDistributionFilter. #8480Added
user_hiddenfield toRepositoryto hide repositories from users. #8487Added a
timestamp_of_interestfield to Content and Artifacts. This field can be updated by calling a new methodtouch()on Artifacts and Content. Plugin writers should call this method whenever they deal with Content or Artifacts. For example, this includes places where Content is uploaded or added to Repository Versions. This will prevent Content and Artifacts from being cleaned up when orphan cleanup becomes a non-blocking task in pulpcore 3.15. #8823Exposed
AsyncUpdateMixinthroughpulpcore.plugin.viewsets. #8844Added a field
DEFAULT_MAX_RETRIESto theRemotebase class - plugin writers can override the default number of retries attempted when file downloads failed for each type of remote. The default value is 3. #8881Added a field
DEFAULT_DOWNLOAD_CONCURRENCYto the Remote base class - plugin writers can override the number of concurrent downloads for each type of remote. The default value is 10. #8897
Bugfixes¶
Fixed OpenAPI schema tag generation for resources that are nested more than 2 levels.
This change is most evident in client libraries generated from the OpenAPI schema.
Prior to this change, the API client for a resource located at /api/v3/pulp/exporters/core/pulp/<uuid>/exports/ was named ExportersCoreExportsApi.
After this change, the API client for a resource located at /api/v3/pulp/exporters/core/pulp/<uuid>/exports/ is named ExportersPulpExportsApi. #8868
Removals¶
The usage of non-JSON serializable types of
argsandkwargsto tasks is no longer supported.uuid.UUIDobjects however will silently be converted tostr. #8501Removed the
versions_containing_contentmethod from the pulpcore.plugin.models.RepositoryVersion` object. Instead useRepositoryVersion.objects.with_content(). #8729Removed pulpcore.plugin.stages.ContentUnassociation from the plugin API. #8827
Deprecations¶
The
pulpcore.plugin.viewsets.NewDistributionFilteris deprecated and will be removed from a future release. Instead usepulpcore.plugin.viewsets.DistributionFilter. #8480Deprecate the use of the reserved_resources_record__resource in favor of reserved_resources_record__contains. Tentative removal release is pulpcore==3.15. #8501
Plugin writers who create custom downloaders by subclassing
HttpDownloaderno longer need to wrap the_run()method with abackoffdecorator. Consequntly thehttp_giveuphandler the sake of thebackoffdecorator is no longer needed and has been deprecated. It is likely to be removed in pulpcore 3.15. #8881
3.13.0 (2021-05-25)¶
REST API¶
Features¶
Added two views to identify content which belongs to repository_version or publication. #4832
Added repository field to repository version endpoints. #6068
Added ability for users to limit how many repo versions Pulp retains by setting
retained_versionson repository. #8368Added the
add-signing-servicemanagement command. Notice that it is still in tech-preview and can change without further notice. #8609Added a
pulpcore-workerentrypoint to simplify and unify the worker command. #8721Content app auto-distributes latest publication if distribution’s
repositoryfield is set #8760
Bugfixes¶
Fixed cleanup of UploadChunks when their corresponding Upload is deleted. #7316
Fixed an issue that caused the request’s context to be ignored in the serializers. #8396
Fixed missing
REDIS_SSLparameter in RQ config. #8525Fixed bug where using forms submissions to create resources (e.g.
Remotes) raised exception about the format ofpulp_labels. #8541Fixed bug where publications sometimes fail with the error ‘[Errno 39] Directory not empty’. #8595
Handled a tasking race condition where cleaning up resource reservations sometimes raised an IntegrityError. #8603
Fixed on-demand sync/migration of repositories that don’t have sha256 checksums. #8625
Taught pulp-export to validate chunk-size to be <= 1TB. #8628
Addressed a race-condition in PulpImport that could fail with unique-constraint violations. #8633
Content app now properly lists all distributions present #8636
Fixed ability to specify custom headers on a Remote. #8689
Fixed compatibility with Django 2.2 LTS. Pulp now requires Django~=2.2.23 #8691
Skip allowed content checks on collectstatic #8711
Fixed a bug in the retained versions code where content wasn’t being properly moved to newer repo versions when old versions were cleaned up. #8793
Improved Documentation¶
Added docs on how to list the effective settings using
dynaconf list. #6235Added anti-instructions, that users should never run pulpcore-manager makemigrations`, but file a bug instead. #6703
Clarified repositories are typed in concepts page #6990
Added UTF-8 character set encoding as a requirement for PostgreSQL #7019
Fixed typo s/comtrol/control #7715
Removed the PUP references from the docs. #7747
Updated plugin writers’ guide to not use settings directly in the model fields. #7776
Make the reference to the Pulp installer documentation more explicit. #8477
Removed example Ansible installer playbook from the pulpcore docs so that Pulp users would have a single source of truth in the pulp-installer docs. #8550
Added security disclosures ref to homepage #8584
Add sequential steps for storage docs #8597
Updated signing service workflow. Removed old deprecation warning. #8609
Add an example of how to specify an array value and a dict key in the auth methods section #8668
Fixed docs build errors reported by autodoc. #8784
Misc¶
Plugin API¶
Features¶
Undeprecated the use of
uuid.UUIDin task arguments. With this, primary keys do not need to be explicitely cast tostr. #8723
Bugfixes¶
Removals¶
Removed deprecated
pulpcore.plugin.tasking.WorkingDirectory. #8354Removed
BaseDistribution,PublicationDistribution, andRepositoryVersionDistributionmodels. RemovedBaseDistributionSerializer,PublicationDistributionSerializer, andRepositoryVersionDistributionSerializerserializers. RemovedBaseDistributionViewSetandDistributionFilter. #8386Removed
pulpcore.plugin.tasking.enqueue_with_reservation. #8497
Deprecations¶
3.12.2 (2021-04-29)¶
REST API¶
Bugfixes¶
Backported a fix for on-demand sync/migration of repositories that don’t have sha256 checksums. #8652
Plugin API¶
No significant changes.
3.12.1 (2021-04-20)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Added RepositoryVersionRelatedField to the plugin API. #8580
3.12.0 (2021-04-08)¶
REST API¶
Features¶
Add support for automatic publishing and distributing. #7626
Add a warning at startup time if there are remote artifacts with checksums but no allowed checksums. #7985
Added support in content app for properly handling unknown or forbidden digest errors. #7989
Added sync check that raises error when only forbidden checksums are found for on-demand content. #8423
Added ability for users to delete repo version 0 as long as they still have at least one repo version for their repo. #8454
Bugfixes¶
Added asynchronous tasking to the Update and Delete endpoints of PulpExporter to provide proper locking on resources. #7438
Fixed a scenario where canceled tasks could be marked failed. #7980
Taught
PulpImportcorrect way to find and importRepositoryVersions. Previous implementation only worked forRepositoryVersionsthat were the ‘current’ version of the exportedRepository. #8116Fixed a race condition that sometimes surfaced during handling of reserved resources. #8352
Made digest and size sync erros more helpful by logging url of the requested files. #8357
Fixed artifact-stage to handle an edge-case when multiple multi-artifact content, from different remotes, is in a single batch. #8377
Fixed Azure artifacts download. #8427
Fixed bug during sync where a unique constraint violation for
Contentwould raise an “X matching query does not exist” error. #8430Fix artifact checksum check to not check on-demand content. #8445
Fixed a bug where the existence of PublishedMetadata caused
LookupErrorwhen querying/pulp/api/v3/content/#8447Distributions are now viewable again at the base url of the content app #8475
Fixed a path in artifact_stages that could lead to sync-failures in pulp_container. #8489
Improved Documentation¶
Update docs with guide how to change ‘ALLOWED_CONTENT_CHECKSUMS’ setting using ‘pulpcore-manager handle-artifact-checksums –report’ if needed. #8325
Removals¶
The Update and Delete endpoints of Exporters changed to now return 202 with tasks. #7438
Deprecation warnings are now being logged by default if the log level includes WARNING. This can be disabled by adjusting the log level of
pulpcore.deprecation. See the deprecation docs for more information. #8499
Misc¶
Plugin API¶
Features¶
Added a new callback method to
Repositorynamedon_new_version(), which runs when a new repository version has been created. This can be used for e.g. automatically publishing or distributing a new repository version after it has been created. #7626Added url as optional argument to
DigestValidationErrorandSizeValidationErrorexceptions to log urls in the exception message. #8357Added the following new objects related to a new
DistributionMasterModel: *pulpcore.plugin.models.Distribution- A new MasterModelDistributionwhich replaces thepulpcore.plugin.models.BaseDistribution. This now contains therepository,repository_version, andpublicationfields on the MasterModel instead of on the detail models as was done withpulpcore.plugin.models.BaseDistribution. *pulpcore.plugin.serializer.DistributionSerializer- A serializer plugin writers should use with the newpulpcore.plugin.models.Distribution. *pulpcore.plugin.viewset.DistributionViewSet- The viewset that replaces the deprecatedpulpcore.plugin.viewset.BaseDistributionViewSet. *pulpcore.plugin.viewset.NewDistributionFilter- The filter that pairs with theDistributionmodel. #8384Added checksum type enforcement to
pulpcore.plugin.download.BaseDownloader. #8435Adds the
pulpcore.plugin.tasking.dispatchinterface which replaces thepulpcore.plugin.tasking.enqueue_with_reservationinterface. It is the same except: * It returns apulpcore.plugin.models.Taskinstead of an RQ object * It does not support theoptionskeyword argumentAdditionally the
pulpcore.plugin.viewsets.OperationPostponedResponsewas updated to support both thedispatchandenqueue_with_reservationinterfaces. #8496
Bugfixes¶
Allow plugins to unset the
queryset_filtering_required_permissionattribute inNamedModelViewSet. #8438
Removals¶
Removed checksum type filtering from
pulpcore.plugin.models.Remote.get_downloaderandpulpcore.plugin.stages.DeclarativeArtifact.download. #8435
Deprecations¶
The following objects were deprecated: *
pulpcore.plugin.models.BaseDistribution– Instead usepulpcore.plugin.models.Distribution. *pulpcore.plugin.viewset.BaseDistributionViewSet– Instead usepulpcore.plugin.viewset.DistributionViewSet. *pulpcore.plugin.serializer.BaseDistributionSerializer– Instead usepulpcore.plugin.serializer.DistributionSerializer. *pulpcore.plugin.serializer.PublicationDistributionSerializer– Instead use define thepublicationfield directly on your detail distribution object. See the docstring forpulpcore.plugin.serializer.DistributionSerializerfor an example. *pulpcore.plugin.serializer.RepositoryVersionDistributionSerializer– Instead use define therepository_versionfield directly on your detail distribution object. See the docstring forpulpcore.plugin.serializer.DistributionSerializerfor an example. *pulpcore.plugin.viewset.DistributionFilter– Instead usepulpcore.plugin.viewset.NewDistributionFilter.Note
You will have to define a migration to move your data from
pulpcore.plugin.models.BaseDistributiontopulpcore.plugin.models.Distribution. See the pulp_file migration 0009 as a reference example.Deprecated the
pulpcore.plugin.tasking.enqueue_with_reservation. Instead use thepulpcore.plugin.tasking.dispatchinterface. #8496The usage of non-JSON serializable types of
argsandkwargsto tasks is deprecated. Future releases of pulpcore may discontinue accepting complex argument types. Note, UUID objects are not JSON serializable. A deprecated warning is logged if a non-JSON serializable is used. #8505
3.11.2 (2021-05-25)¶
REST API¶
Bugfixes¶
Skip allowed content checks on collectstatic (backported from #8711) #8712
Fixed cleanup of UploadChunks when their corresponding Upload is deleted. (backported from #7316) #8757
Fixed compatibility with Django 2.2 LTS. Pulp now requires Django~=2.2.23 (backported from #8691) #8758
Pinned click~=7.1.2 to ensure RQ is compatible with it. #8767
Plugin API¶
No significant changes.
3.11.1 (2021-04-29)¶
REST API¶
Bugfixes¶
Plugin API¶
Bugfixes¶
Allow plugins to unset the
queryset_filtering_required_permissionattribute inNamedModelViewSet. #8444
3.11.0 (2021-03-15)¶
REST API¶
Features¶
Raise error when syncing content with a checksum not included in
ALLOWED_CONTENT_CHECKSUMS. #7854User can evaluate how many content units are affected with checksum type change with ‘pulpcore-manager handle-artifact-checksums –report’. #7986
The fields
proxy_usernameandproxy_passwordhave been added to remotes. Credentials can no longer be specified as part of theproxy_url. A data migration will move the proxy auth information on existing remotes to the new fields. #8167Added the
WORKER_TTLsetting, that specifies the interval a worker is considered missing after its last heartbeat. #8291Due to the removal of
md5andsha1from theALLOWED_CONTENT_CHECKSUMSsetting, every system that had any Artifacts synced in in prior to 3.11 will have to run thepulpcore-manager handle-content-checksumscommand. A data migration is provided with 3.11 that will run this automatically as part of thepulpcore-manager migratecommand all upgrades must run anyway. #8322
Bugfixes¶
Fixed a bug experienced by the migration plugin where all content objects are assumed to have a remote associated with them. #7876
Restored inadvertently-changed content-guards API to its correct endpoint.
In the process of adding generic list-endpoints, the /pulp/api/v3/contentguards API was inadvertently rehomed to /pulp/api/v3/content_guards. This change restores it to its published value. #8283
Added headers field to the list of fields in the
RemoteSerializerbase class and marked it optional to make it accessible via the REST api. #8330Fixed AccessPolicy AttributeError. #8395
Improved Documentation¶
Removed correlation id feature from tech preview. #7927
Removed ‘tech preview’ label from
handle-artifact-checksumscommand.handle-artifact-checksumsis now a fully-supported part of Pulp3. #7928Added a warning banner to the
ALLOWED_CONTENT_CHECKSUMSsetting section indicating the setting is not fully enforcing inpulpcorecode and various plugins. #8342
Removals¶
The
componentfield of theversionssection of the status API`/pulp/api/v3/status/now lists the Django app name, not the Python package name. Similarly the OpenAPI schema at/pulp/api/v3does also. #8198Removed sensitive fields
username,password, andclient_keyfrom Remote responses. These fields can still be set and updated but will no longer be readable. #8202Adjusted the
ALLOWED_CONTENT_CHECKSUMSsetting to removemd5andsha1since they are insecure. Now, by default, theALLOWED_CONTENT_CHECKSUMScontainsha224,sha256,sha384, andsha512. #8246
Misc¶
Plugin API¶
Features¶
Allow developers to use more than one WorkingDirectory() within a task, including nested calls. Tasks will also now use a temporary working directory by default. #7815
Added the
pulpcore.app.pulp_hashlibmodule which provides thenewfunction and ensures only allowed hashers listed inALLOWED_CONTENT_CHECKSUMScan be instantiated. Plugin writers should use this instead ofhashlib.newto generate checksum hashers. #7984Add a
get_contentmethod topulpcore.plugin.models.RepositoryVersionthat accepts a queryset and returns a list of content in that repository using the given queryset. This allows for specific content type to be returned by executingrepo_version.get_content(content_qs=MyContentType.objects). #8375
Improved Documentation¶
Removals¶
Adjusted the
ALLOWED_CONTENT_CHECKSUMSsetting to removemd5andsha1since they are insecure. Now, by default, theALLOWED_CONTENT_CHECKSUMScontainsha224,sha256,sha384, andsha512. #8246Removed unused get_plugin_storage_path method. #8343
It is not longer possible to address AccessPolicy via the viewset’s classname. Viewset’s urlpattern should be used instead. #8397
Removed deprecated key field returned by the signing service. Plugin writers must now refer directly to the public_key field on the signing service object. #8398
Deprecations¶
pulpcore.plugin.tasking.WorkingDirectoryhas been deprecated. #8231
3.10.0 (2021-02-04)¶
REST API¶
Features¶
Change the default deployment layout
This changes the default deployment layout. The main change is that MEDIA_ROOT gets its own directory. This allows limiting the file permissions in a shared Pulp 2 + Pulp 3 deployment and the SELinux file contexts. Another benefit is compatibility with django_extensions’ unreferenced_files command which lists all files in MEDIA_ROOT that are not in the database.
Other paths are kept on the same absolute paths. The documentation is updated to show the latest best practices. #7178
Added general endpoints to list
Content,ContentGuards, andRepositories. #7204Added /importers/core/pulp/import-check/ to validate import-parameters. #7549
Added a new field called public_key to SigningService. This field preserves the value of the public key. In addition to that, the field fingerprint was introduced as well. This field identifies the public key. #7700
Added possibility to filter users and groups by various fields. #7975
Added pulp_labels to allow users to add key/value data to objects. #8065
Added
pulp_label_selectfilter to allow users to filter by labels. #8067Added optional headers field to the aiohttp ClientSession. #8083
Allow querying names on the api using name__icontains, name__contains and name__startswith query parameters. #8094
Added RBAC to the endpoint for managing groups. #8159
Added RBAC to the endpoint for managing group users. #8160
Added the
AccessPolicy.customizedfield which ifTrueindicates a user has modified the default AccessPolicy. #8182Added filtering for access policies. #8189
As an authenticated user I can create and view artifacts. #8193
Bugfixes¶
Fixed bug where duplicate artifact error message was nondeterministic in displaying different error messages with different checksum types. Also, updated duplicate artifact error message to be more descriptive. #3387
Fixed Pulp import/export bug that occurs when sha384 or sha512 is not in
ALLOWED_CONTENT_CHECKSUMS. #7836X-CSRFToken is not sent through ajax requests (PUT) in api.html. Fixed by setting the right value in the JS code. #7888
Provide a mechanism to automatically resolve issues and prevent deadlocks when Redis experiences data loss (such as a restart). #7912
Silence unnecessary log messages from django_guid which were spamming up the logs. #7982
Changed the default permission class to
IsAdminUserto protect endpoints not yet guarded by an access policy from users without permission. #8018Fixed apidoc bug, where model and object permissions on groups overlapped. #8033
Fixed the viewset_name used by access policy for the cases when parent_viewset is involved. #8152
Made the viewset_name property of access policies read only. #8185
Improved Documentation¶
Misc¶
Plugin API¶
Features¶
Add
rate_limitoption toRemote#7965Made DistributionFilter accessible to plugin writers. #8059
Adding
LabelandLabelSerializerto the plugin api. #8065Added
LabelSelectFilterto filter resources by labels. #8067Added ReadOnlyRepositoryViewset to the plugin API. #8103
Added NAME_FILTER_OPTIONS to the plugin API to gain more consistency across plugins when filter by name or similar CharFields. #8117
Added has_repo_attr_obj_perms and has_repo_attr_model_or_obj_perms to the global access checks available to all plugins to use. #8161
Removals¶
Plugins are required to define a
versionattribute on their subclass ofPulpPluginAppConfig. Starting with pulpcore==3.10, if undefined while Pulp loads, Pulp will refuse to start. #7930Changed the default permission class to from
IsAuthenticatedtoIsAdminUser. Any endpoints that should be accessible by all known to the system users need to specify the permission_classes accordingly. #8018pulpcore.plugin.models.UnsupportedDigestValidationErrorhas been removed. Plugins should look for this atpulpcore.plugin.exceptions.UnsupportedDigestValidationErrorinstead. #8169
Deprecations¶
3.9.1 (2021-01-21)¶
REST API¶
Removals¶
CHUNKED_UPLOAD_DIR was converted to a relative path inside MEDIA_ROOT. #8099
Plugin API¶
No significant changes.
3.9.0 (2020-12-07)¶
REST API¶
Features¶
Made uploaded chunks to be stored as separate files in the default storage. This feature removes the need for a share storage of pulp api nodes, as the chunks are now stored individually in the shared storage and are therefore accessible by all nodes. #4498
Add support for logging messages with a correlation id that can either be autogenerated or passed in with a
Correlation-IDheader. This feature is provided as a tech preview in pulpcore 3.9. #4689Added progress reporting for pulp imports. #6559
Exposed
aiohttp.ClientTimeoutfields inRemoteasconnect_timeout,sock_connect_timeout,sock_read_timeout, andtotal_timeout.This replaces the previous hard-coded 600 second timeout for sock_connect and sock_read, giving per-
Remotecontrol of all fourClientTimeoutfields to the user. #7201Enabled users to add checksums to ALLOWED_CONTENT_CHECKSUMS by allowing them to populate checksums with handle-artifact-checksums command. #7561
Added version information to api docs. #7569
Made signing services to be immutable. This requires content signers to create a new signing service explicitly when a change occurs. #7701
Added support for repairing Pulp by detecting and redownloading missing or corrupted artifact files. Sending a POST request to
/pulp/api/v3/repair/will trigger a task that scans all artifacts for missing and corrupted files in Pulp storage, and will attempt to redownload them from the original remote. Specifyingverify_checksums=Falsewhen POSTing to the same endpoint will skip checking the hashes of the files (corruption detection) and will instead just look for missing files.The
verify_checksumsPOST parameter was added to the existing “repository version repair” endpoint as well. #7755Added check to prevent Pulp to start if there are Artifacts with forbidden checksums. #7914
Bugfixes¶
Fixed a serious bug data integrity bug where some Artifact files could be silently deleted from storage in specific circumstances. #7676
Moved the initial creation of access_policies to post_migrate signal. This enforces their existance both with migrate and flush. #7710
Fixed incremental export to happen if start_version provided, even if last_export is null. #7716
Fixed a file descriptor leak during repository version repair operations. #7735
Fixed bug where exporter directory existed and was writable but not owned by worker process and thus not chmod-able. #7829
Properly namespaced the viewset_name in AccessPolicy to avoid naming conflicts in plugins. #7845
Update jquery version from 3.3.1 to 3.5.1 in API.html template. It is the version provided by djangorestframework~=3.12.2 #7850
Prevented a Redis failure scenario from causing the tasking system to back up due to “tasking system locks” not being released, even on worker restart. #7907
Use subclassed plugin downloaders during the pulp repair. #7909
Improved Documentation¶
Removals¶
The local file system directory used for uploaded chunks is specified by the setting CHUNKED_UPLOAD_DIR. Users are encouraged to remove all uncommitted uploaded files before applying this change. #4498
Misc¶
Plugin API¶
Features¶
Added pre_save hook to Artifact to enforce checksum rules implied by ALLOWED_CONTENT_CHECKSUMS. #7696
Enabled plugin writers to retrieve a request object from a serializer when look ups are performed from within the task serializer. #7718
Expose ProgressReportSerializer through pulpcore.plugin #7759
Allowed plugin writers to access the models Upload and UploadChunk #7833
Exposed
pulpcore.plugin.constants.ALL_KNOWN_CONTENT_CHECKSUMS. #7897Added
UnsupportedDigestValidationErrortopulpcore.plugins.exceptions. Going forward, plugin authors can expect to find all unique exceptions underpulpcore.plugin.exceptions. #7908
Deprecations¶
Plugins are encouraged to define a
versionattribute on their subclass ofPulpPluginAppConfig. If undefined while Pulp loads a warning is now shown to encourage plugin writers to implement this attribute, which will be required starting in pulpcore==3.10. #6671Using the ViewSet’s classname to identify its AccessPolicy has been deprecated and is slated for removal in 3.10. Instead the urlpattern is supposed to be used.
Plugins with existing AccessPolicies should add a data migration to rename their AccessPolicies:
- ::
access_policy = AccessPolicy.get(viewset_name=”MyViewSet”) access_policy.viewset_name = “objectclass/myplugin/myclass” access_policy.save()
The
pulpcore.plugin.models.UnsupportedDigestValidationErroris being deprecated and will be removed in 3.10.It can now be found at
pulpcore.plugin.exceptions.UnsupportedDigestValidationErrorinstead; please change any code that imports it to access it from its new location. #7908
3.8.1 (2020-10-30)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.8.0 (2020-10-20)¶
REST API¶
Features¶
Added check to prevent users from adding checksums to
ALLOWED_CONTENT_CHECKSUMSif there are Artifacts without those checksums. #7487Django admin site URL is configurable via ADMIN_SITE_URL settings parameter. #7637
Always set a default for DJANGO_SETTINGS_MODULE. This means the services files don’t need to. #7720
Bugfixes¶
Fix a warning inappropriately logged when cancelling a task. #4559
When a task is canceled, we now set the state of all incomplete “progress reports” to canceled as well. #4921
Properly handle duplicate content during synchronization and migration from Pulp 2 to 3. #7147
Enable content streaming for RepositoryVersionDistribution #7568
Change dropped DRF filter to django urlize. #7634
Added some more files to MANIFEST.in. #7656
Updated dynaconf requirement to prevent use of older buggy versions. #7682
Improved Documentation¶
Updated examples of auto-distribution. #5247
Improved testing section in Pulp contributor docs. Mentioned prestart, pminio, pfixtures and phelp. #7475
Fix an erroneous API endpoint in the “upload and publish” workflow documentation. #7655
Documented that we don’t support backporting migrations. #7657
Plugin API¶
Improved Documentation¶
Removed mentions of semver in the plugin API docs, and replaced them with a link to the deprecation policy where appropriate. #7555
3.7.9 (2021-11-30)¶
REST API¶
Bugfixes¶
Prevented a Redis failure scenario from causing the tasking system to back up due to “tasking system locks” not being released, even on worker restart. (backported from #7907) #9547
Prevent proxy credentials to be passed to aiohttp, so they no longer appear in stack traces. This is a rewritten backport of #8167. #9573
Plugin API¶
No significant changes.
3.7.8 (2021-08-24)¶
REST API¶
Bugfixes¶
In stages-pipeline and new-version sanity-checks, added full error-info on path-problems. (backported from #8133) #9227
Plugin API¶
Bugfixes¶
Added kwarg to RemoteArtifactSaver init to allow enabling handling of rare error edge-case.
fix_mismatched_remote_artifacts=True enables workaround for a failure-scenario that (so far) is only encountered by pulp_rpm. Current behavior is the default. (backported from #8133) #9227
3.7.7 (2021-07-26)¶
REST API¶
Bugfixes¶
Fixed a bug, where new tasks were assigned to dead workers. (backported from #8779) #9118
Plugin API¶
No significant changes.
3.7.6 (2021-04-29)¶
REST API¶
Bugfixes¶
Backported a fix for on-demand sync/migration of repositories that don’t have sha256 checksums. #8651
Plugin API¶
No significant changes.
3.7.5 (2021-04-12)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.7.4 (2021-03-15)¶
REST API¶
Bugfixes¶
No longer load .env files. They are not used by Pulp but potentially can break the setup. #8373
Plugin API¶
No significant changes.
3.7.3 (2020-10-28)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.7.2 (2020-10-21)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.7.1 (2020-09-29)¶
REST API¶
Bugfixes¶
Including functest_requirements.txt on MANIFEST.in #7610
Plugin API¶
No significant changes.
3.7.0 (2020-09-22)¶
REST API¶
Features¶
Added setting ALLOWED_CONTENT_CHECKSUMS to support limiting the checksum-algorithms Pulp uses. #5216
Added progress-reports to the PulpExport task. #6541
Improve performance and memory consumption of orphan cleanup. #6581
Extra require: s3, azure, prometheus and test #6844
Added the toc_info attribute with filename/sha256sum to PulpExport, to enable direct access to the export-TOC. #7221
Taught export-process to clean up broken files if the export fails. #7246
Added the django-cleanup handlers for removing files stored within FileField #7316
Added deprecations section to the changelog. #7415
Bugfixes¶
Address some problems with stuck tasks when connection to redis is interrupted. #6449
Fixed a bug where creating an incomplete repository version (via canceled or failed task) could cause future operations to fail. #6463
Added validation for unknown serializers’ fields #7245
Fixed: PulpTemporaryFile stored in the wrong location #7319
Fixed an edge case where canceled tasks might sometimes be processed and marked completed. #7389
Fixed pulp-export scenario where specifying full= could fail silently. #7403
Fixed OpenAPI creation response status code to 201 #7444
The
AccessPolicy.permissions_assignmentcan now be null, which some viewset endpoints may require. #7448Taught export to insure export-dir was writeable by group as well as owner. #7459
Fixed orphan cleanup for subrepositories (e.g. an add-on repository in RPM distribution tree repository). #7460
Fixed issue with reserved resources not being displayed for waiting tasks. #7497
Fixed broken bindings resulting from drf-spectacular 0.9.13 release. #7510
Fix filesystem exports failing due to undefinied
validate_pathmethod. #7521Fix a bug that prevented users from adding permissions for models have conflicting names across different django apps. #7541
Improved Documentation¶
Added pulp 2 obsolete concepts (consumers, applicability). #6255
Misc¶
Plugin API¶
Features¶
Bugfixes¶
The
AccessPolicy.permissions_assignmentcan now be null, which some viewset endpoints may require. #7448
Improved Documentation¶
Added an example how to use a serializer to create validated objects. #5927
Document the URLField OpenAPI issue #6828
Added all exported models to the autogenerated API reference. #7045
Updated docs recommending plugins to rely on a 1-release deprecation process for backwards incompatible changes in the
pulpcore.plugin. #7413Adds plugin writer docs on how to ship snippets which override default webserver routes provided by the installer. #7471
Revises the “installation plugin custom tasks” documentation to reflect that plugin writers can contribute their custom installation needs directly to the installer. #7523
Misc¶
3.6.5 (2020-10-28)¶
REST API¶
Bugfixes¶
Plugin API¶
No significant changes.
3.6.4 (2020-09-23)¶
REST API¶
Bugfixes¶
Fixed broken bindings resulting from drf-spectacular 0.9.13 release. #7510
Plugin API¶
No significant changes.
3.6.3 (2020-09-04)¶
REST API¶
Misc¶
Plugin API¶
No significant changes.
3.6.2 (2020-09-02)¶
REST API¶
No significant changes.
Plugin API¶
Bugfixes¶
Remove customized operation_id from OrphansView #7446
3.6.1 (2020-09-01)¶
REST API¶
Bugfixes¶
Fixing groups API validation #7329
Improved Documentation¶
Misc¶
Plugin API¶
Bugfixes¶
3.6.0 (2020-08-13)¶
REST API¶
Features¶
Added table-of-contents to export and gave import a toc= to find/reassemble pieces on import. #6737
Added ability to associate a Remote with a Repository so users no longer have to specify Remote when syncing. #7015
The /pulp/api/v3/access_policies/ endpoint is available for reading and modifying the AccessPolicy used for Role Based Access Control for all Pulp endpoints. This allows for complete customization of the Authorization policies.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #7160
The /pulp/api/v3/access_policies/ endpoint also includes a permissions_assignment section which customizes the permissions assigned to new objects. This allows for complete customization for how new objects work with custom define Authorization policies. #7210
The /pulp/api/v3/users/ endpoint is available for reading the Users, Group membership, and Permissions.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #7231
The /pulp/api/v3/groups/ endpoint is available for reading the Groups, membership, and Permissions.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #7232
The /pulp/api/v3/tasks/ endpoint now provides a user-isolation behavior for non-admin users. This policy is controllable at the /pulp/api/v3/access_policies/ endpoint.
NOTE: The user-isolation behavior is in “tech preview” and production systems are recommended to continue using the build-in
adminuser only. #7301Extended endpoint /pulp/api/v3/groups/:pk/users to add and remove users from a group.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #7310
Extended endpoints /pulp/api/v3/groups/:pk/model_permissions and /pulp/api/v3/groups/:pk/object_permissions to add and remove permissions from a group.
NOTE: this endpoint is in tech-preview and may change in backwards incompatible ways in the future. #7311
Bugfixes¶
WorkerDirectory.delete() no longer recursively trys to delete itself when encountering a permission error #6504
Stopped preventing removal of PulpExport/Exporter when last-export existed. #6555
First time on demand content requests appear in the access log. #7002
Fixed denial of service caused by extra slashes in content urls. #7066
Set a default DJANGO_SETTINGS_MODULE env var in content app #7179
Added plugin namespace to openapi href identifier. #7209
By default, html in field descriptions filtered out in REST API docs unless ‘include_html’ is set. #7299
Fixed plugin filtering in bindings to work independently from “bindings” parameter. #7306
Improved Documentation¶
Deprecations and Removals¶
Removed unnecessary fields from the import/export transfer. #6515
Upgrading the api documentation from OpenAPI v2 to OpenAPI v3. - Methods signatures for bindings may change. #7108
Changed default
download_concurrencyon Remotes from 20 to 10 to avoid connection problems. Also updated existing Remotes withdownload_concurrencyof 20 to 10. #7212
Misc¶
Plugin API¶
Features¶
Adding PulpTemporaryFile for handling temporary files between the viewset and triggered tasks #6749
RepositorySyncURLSerializerwill now check remote on the repository before it raises an exception if the remote param is not set. #7015Added a hook on
Repositorycalledartifacts_for_version()that plugins can override to modify the logic behindRepositoryVersion.artifacts. For now, this is used when exporting artifacts. #7021Enabling plugin writers to have more control on HttpDownloader response codes 400+ by subclassing HttpDownloader and overwriting raise_for_status method #7117
BaseModel now inherits from LifecycleModel provided by django-lifecycle allowing any subclass to also use it instead of signals. #7151
A new pulpcore.plugin.models.AutoDeleteObjPermsMixin object can be added to models to automatically delete all user and group permissions for an object just before the object is deleted. This provides an easy cleanup mechanism and can be added to models as a mixin. Note that your model must support django-lifecycle to use this mixin. #7157
A new model pulpcore.plugin.models.AccessPolicy is available to store AccessPolicy statements in the database. The model’s statements field stores the list of policy statements as a JSON field. The name field stores the name of the Viewset the AccessPolicy is protecting.
Additionally, the pulpcore.plugin.access_policy.AccessPolicyFromDB is a drf-access-policy which viewsets can use to protect their viewsets with. See the Viewset Enforcement for more information on this. #7158
Adds the TaskViewSet and TaskGroupViewSet objects to the plugin api. #7187
Enabled plugin writers to create immutable repository ViewSets #7191
A new pulpcore.plugin.models.AutoAddObjPermsMixin object can be added to models to automatically add permissions for an object just after the object is created. This is controlled by data saved in the permissions_assignment attribute of the pulpcore.plugin.models.AccessPolicy allowing users to control what permissions are created. Note that your model must support django-lifecycle to use this mixin. #7210
Added ability for plugin writers to set a
content_mappingproperty on content resources to provide a custom mapping of content to repositories. #7252Automatically excluding
pulp_id,pulp_created, andpulp_last_updatedforQueryModelResources. #7277Viewsets that subclass
pulpcore.plugin.viewsets.NamedModelViewSet` can declare the ``queryset_filtering_required_permissionclass attribute naming the permission required to view an object. See the Restricting Viewable Objects documentation for more information. #7300
Bugfixes¶
Making operation_id unique #7233
Making ReDoc OpenAPI summary human readable #7237
OpenAPI schema generation from CLI #7258
Allow pulpcore.plugin.models.AutoAddObjPermsMixin.add_for_object_creator to skip assignment of permissions if there is no known user. This allows endpoints that do not use authorization but still create objects in the DB to execute without error. #7312
Improved Documentation¶
Deprecations and Removals¶
Newlines in certificate string (ca_cert, client_cert, client_key) on Remotes are not required to be escaped. #6735
Replaced drf-yasg with drf-spectacular. - This updates the api documentation to openapi v3. - Plugins may require changes. - Methods signatures for bindings may change. #7108
Moving containers from pulpcore to pulp-operator #7171
3.5.0 (2020-07-08)¶
REST API¶
Features¶
Bugfixes¶
Fixed ‘integer out of range’ error during sync by changing RemoteArtifact size field to BigIntegerField. #6717
Added a more descriptive error message that is shown when CONTENT_ORIGIN is not properly configured #6771
Including requirements.txt on MANIFEST.in #6888
Corrected a number of filters to be django-filter-2.3.0-compliant. #6915
Locked Content table to prevent import-deadlock. #7073
Improved Documentation¶
Deprecations and Removals¶
Removes the Write models from the OpenAPI schema. Brings back the models that were accidentally removed from the OpenAPI schema in 3.4.0 release. #7087
Misc¶
Plugin API¶
Features¶
3.4.1 (2020-06-03)¶
REST API¶
Bugfixes¶
Including requirements.txt on MANIFEST.in #6888
Plugin API¶
No significant changes.
3.4.0 (2020-05-27)¶
REST API¶
Features¶
Implemented incremental-exporting for PulpExport. #6136
Added support for S3 and other non-filesystem storage options to pulp import/export functionality. #6456
Optimized imports by having repository versions processed using child tasks. #6484
Added repository type check during Pulp imports. #6532
Added version checking to import process. #6558
Taught PulpExport to export by RepositoryVersions if specified. #6566
Task groups now have an ‘all_tasks_dispatched’ field which denotes that no more tasks will spawn as part of this group. #6591
Taught export how to split export-file into chunk_size bytes. #6736
Bugfixes¶
Remote fields username and password show up in: REST docs, API responses, and are available in the bindings. #6346
Fixed a bug, where the attempt to cancel a completed task lead to a strange response. #6465
Fixed KeyError during OpenAPI schema generation. #6468
Added a missing trailing slash to distribution’s base_url #6507
Fixed a bug where the wrong kind of error was being raised for href parameters of mismatched types. #6521
containers: Fix pulp_rpm 3.3.0 install by replacing the python3-createrepo_c RPM with its build-dependencies, so createrep_c gets installed & built from PyPI #6523
Fixed OpenAPI schema for importer and export APIs. #6556
Normalized export-file-path for PulpExports. #6564
Changed repository viewset to use the general_update and general_delete tasks. This fixes a bug where updating specialized fields of a repository was impossible due to using the wrong serializer. #6569
Only uses multipart OpenAPI Schema when dealing with file fields #6702
Fixed a bug that prevented write_only fields from being present in the API docs and bindings #6775
Added proper headers for index.html pages served by content app. #6802
Removed Content-Encoding header from pulpcore-content responses. #6831
Improved Documentation¶
Adding docs for importing and exporting from Pulp to Pulp. #6364
Add some documentation around TaskGroups. #6641
Introduced a brief explanation about pulp_installer #6674
Added a warning that the REST API is not safe for multi-user use until RBAC is implemented. #6692
Updated the required roles names #6758
Deprecations and Removals¶
Changed repositories field on
/pulp/api/v3/exporters/core/pulp/from UUIDs to hrefs. #6457Imports now spawn child tasks which can be fetched via the
child_tasksfield of the import task. #6484Content of ssl certificates and keys changed to be return their full value instead of sha256 through REST API. #6691
Replaced PulpExport filename/sha256 fields, with output_info_file, a ‘<filename>’: ‘<hash>’ dictionary. #6736
Misc¶
Plugin API¶
Features¶
Added new NoArtifactContentUploadSerializer and NoArtifactContentUploadViewSet to enable plugin writers to upload content without storing an Artifact #6281
Added view_name_pattern to DetailRelatedField and DetailIdentityField to properly identify wrong resource types. #6521
Added support for Distributions to provide non-Artifact content via a content_handler. #6570
Added constants to the plugin API at
pulpcore.plugin.constants. #6579TaskGroups now have an ‘all_tasks_dispatched’ field that can be used to notify systems that no further tasks will be dispatched for a TaskGroup. Plugin writers should call “.finish()” on all TaskGroups created once they are done using them to set this field. #6591
Bugfixes¶
Added
RemoteFilterto the plugin API as it was missing but used by plugin_template. #6563
Deprecations and Removals¶
Fields: username and password will be returned to the rest API user requesting a Remote #6346
Rehomed QueryModelResource to pulpcore.plugin.importexport. #6514
The
pulpcore.content.handler.Handler.list_directory()function now returns a set of strings where it returned a string of HTML before. #6570
3.3.1 (2020-05-07)¶
REST API¶
Bugfixes¶
Plugin API¶
Features¶
Add TaskGroup to the plugin API. #6603
3.3.0 (2020-04-15)¶
REST API¶
Features¶
Added support for repairing a RepositoryVersion by redownloading corrupted artifact files. Sending a POST request to
/pulp/api/v3/repositories/<plugin>/<type>/<repository-uuid>/versions/<version-number>/repair/will trigger a task that scans all associated artfacts and attempts to fetch missing or corrupted ones again. #5613Added support for exporting pulp-repo-versions. POSTing to an exporter using the
/pulp/api/v3/exporters/core/pulp/<exporter-uuid>/exports/API will instantiate a PulpExport entity, which will generate an export-tar.gz file at<exporter.path>/export-<export-uuid>-YYYYMMDD_hhMM.tar.gz#6135Added API for importing Pulp Exports at
POST /importers/core/pulp/<uuid>/imports/. #6137Added the new setting CHUNKED_UPLOAD_DIR for configuring a default directory used for uploads #6253
Exported SigningService in plugin api #6256
Added name filter for SigningService #6257
Relationships between tasks that spawn other tasks will be shown in the Task API. #6282
Added a new APIs for PulpExporters and Exports at
/exporters/core/pulp/and/exporters/core/pulp/<uuid>/exports/. #6328Added PulpImporter API at
/pulp/api/v3/importers/core/pulp/. PulpImporters are used for importing exports from Pulp. #6329Added an
ALLOWED_EXPORT_PATHSsetting with list of filesystem locations that exporters can export to. #6335Indroduced ordering keyword, which orders the results by specified field. Pulp objects will by default be ordered by pulp_created if that field exists. #6347
Task Groups added – Plugin writers can spawn tasks as part of a “task group”, which facilitates easier monitoring of related tasks. #6414
Bugfixes¶
Improved the overall performance while syncing very large repositories #6121
Made chunked uploads to be stored in a local file system instead of a default file storage #6253
Fixed 500 error when calling modify on nonexistent repo. #6284
Fixed bug where user could delete repository version 0 but not recreate it by preventing users from deleting repo version 0. #6308
Fixed non unique content units on content list #6347
Properly sort endpoints during generation of the OpenAPI schema. #6372
Improved resync performance by up to 2x with a change to the content stages. #6373
Fixed bug where ‘secret’ fields would be set to the sha256 checksum of the original value. #6402
Fixed pulp containers not allowing commands to be run via absolute path. #6420
Improved Documentation¶
Documented bindings installation for a dev environment #6221
Added documentation for how to write changelog messages. #6336
Cleared up a line in the database settings documentation that was ambiguous. #6384
Updated docs to reflect that S3/Azure are supported and no longer tech preview. #6443
Added tech preview note to docs for importers/exporters. #6454
Renamed ansible-pulp to pulp_installer (to avoid confusion with pulp-ansible) #6461
Fixed missing terms in documentation. #6485
Deprecations and Removals¶
Misc¶
Plugin API¶
Features¶
Tasks can now be spawned from inside other tasks, and these relationships can be explored via the “parent_task” field and “child_tasks” related name on the Task model. #6282
Added a new Export model, serializer, and viewset. #6328
Added models Import and Importer (as well as serializers and viewsets) that can be used for importing data into Pulp. #6329
NamedModelViewSet uses a default ordering of -pulp_created using the StableOrderingFilter. Users using the ordering keyword will be the primary ordering used when specified. #6347
Added two new repo validation methods (validate_repo_version and validate_duplicate_content). #6362
enqueue_with_reservation() provides a new optional argument for “task_group”. #6414
Bugfixes¶
Fixed bug where RepositoryVersion.artifacts returns None. #6439
Improved Documentation¶
Deprecations and Removals¶
Changed master model from FileSystemExporter to Exporter. Plugins will still need to extend FileSystemExporter but the master table is now core_exporter. This will require that plugins drop and recreate their filesystem exporter tables. #6328
RepositoryVersion add_content no longer checks for duplicate content. #6362
Misc¶
3.2.1 (2020-03-17)¶
REST API¶
Misc¶
Plugin API¶
No significant changes.
3.2.0 (2020-02-26)¶
REST API¶
Features¶
Bugfixes¶
Considering base version when removing duplicates #5964
Renames /var/lib/pulp/static/ to /var/lib/pulp/assets/. #5995
Disabled the trimming of leading and trailing whitespace characters which led to a situation where a hash of a certificate computed in Pulp was not equal to a hash generated locally #6025
Repository.latest_version() considering deleted versions #6147
Stopped HttpDownloader sending basic auth credentials to redirect location if domains don’t match. #6227
Improved Documentation¶
Updated docs to suggest to use
pulpcore-managercommand instead ofdjango-admindirectly. #5859
Deprecations and Removals¶
Renaming Repository.last_version to Repository.next_version #6147
Misc¶
Plugin API¶
Features¶
Adding not equal lookup to model field filters. #5868
Improved Documentation¶
Adds plugin writer docs on adding custom url routes and having the installer configure the reverse proxy to route them. #6209
3.1.1 (2020-02-17)¶
REST API¶
Bugfixes¶
Content with duplicate repo_key_fields raises an error #5567
Resolve content app errors
django.db.utils.InterfaceError: connection already closed. #6045Fix a bug that could cause an inability to detect an invalid signing script during the validation #6077
Fixing broken S3 redirect #6154
Pin idna==2.8` to avoid a version conflict caused by the idna 2.9 release. #6169
Plugin API¶
Features¶
A new method
_reset_db_connectionhas been added tocontent.Handler. It can be called before accessing the db to ensure that the db connection is alive. #6045
3.1.0 (2020-01-30)¶
REST API¶
Features¶
Allow administrators to add a signing service #5943
Adds
pulpcore.app.authentication.PulpDoNotCreateUsersRemoteUserBackendwhich can be used to verify authentication in the webserver, but will not automatically create users likedjango.contrib.auth.backends.RemoteUserBackenddoes. #5949Allow Azure blob storage to be used as DEFAULT_FILE_STORAGE for Pulp #5954
Allow to filter publications by
repository_versionandpulp_created#5968Adds the
ALLOWED_IMPORT_PATHSsetting which can specify the file path prefix thatfile:///remote paths can import from. #5974Allow the same artifact to be published at multiple relative paths in the same publication. #6037
Bugfixes¶
Improved Documentation¶
Rewrote the Authentication page for more clarity on how to configure Pulp’s authentication. #5949
Deprecations and Removals¶
Removed the
django.contrib.auth.backends.RemoteUserBackendas a default configured backend insettings.AUTHENTICATION_BACKENDS. Also removedpulpcore.app.authentication.PulpRemoteUserAuthenticationfrom the DRF configuration ofDEFAULT_AUTHENTICATION_CLASSES. #5949Importing from file:/// now requires the configuration of the
ALLOWED_IMPORT_PATHSsetting. Without this configuration, Pulp will not import content fromfile:///locations correctly. #5974
Misc¶
Plugin API¶
Features¶
Deprecations and Removals¶
The
`Handler._handle_file_response` has been removed. It was renamed to ``_serve_content_artifactand has the following signature:def _serve_content_artifact(self, content_artifact, headers):
Remove get_or_create_future and does_batch from DeclarativeContent. Replaced by awaiting for resolution on the DeclarativeContent itself. #5668
3.0.1 (2020-01-15)¶
REST API¶
Bugfixes¶
Fix bug where content shows as being added and removed in the same version. #5707
Fix bug where calling Repository new_version() outside of task raises exception. #5894
Adjusts setup.py classifier to show 3.0 as Production/Stable. #5896
Importing from file:/// paths no longer destroys the source repository. #5941
Webserver auth no longer prompts for csrf incorrectly. #5955
Deprecations and Removals¶
Removed
pulpcore.app.middleware.PulpRemoteUserMiddlewarefrom the default middleware section. Also replacedrest_framework.authentication.RemoteUserAuthenticationwithpulpcore.app.authentication.PulpRemoteUserAuthenticationin the Django Rest Framework portion of the config. #5955
Misc¶
Plugin API¶
Features¶
Added an optional parameter base_version to RepositoryVersion add() and removed() methods. #5706
Deprecations and Removals¶
3.0.0 (2019-12-11)¶
Note
Task names, e.g. pulpcore.app.tasks.orphan.orphan_cleanup, are subject to change in future
releases 3.y releases. These are represented in the Task API as the “name” attribute. Please
check future release notes to see when these names will be considered stable. Otherwise, the
REST API pulpcore provides is considered semantically versioned.
REST API¶
Features¶
Pulp will do validation that a new repository version contains only content which is supported by the Repository type. Using the same a-priori knowledge of content types, increase performance of duplicate removal. #5701
Bugfixes¶
Improve speed and memory performance. #5688
Improved Documentation¶
Plugin API¶
Features¶
Added a new required field called CONTENT_TYPES to the Repository model. #5701
3.0.0rc2¶
Comprehensive list of changes and bugfixes for rc 2.
Breaking Changes¶
Default port changes happened in the Ansible Installer for Pulp and pulpcore was updated to match with this PR. Existing installs are unaffected. This was done to avoid conflicts that would prevent Pulp from starting by default in many environments; the previous ports (8000 & 8080) are commonly used by management webGUIs, development webservers, etc.
Publications are now Master/Detail which causes any Publication URL endpoint to change. To give an example from pulp_file see the URL changes made here as an example. See plugin docs compatible with 3.0.0rc2 for more details.
Distributions are now Master/Detail which causes the Distribution URL endpoint to change. To give an example from pulp_file see the URL changes made in this PR as an example. See plugin docs compatible with 3.0.0rc2 for more details.
The semantics of Remote attributes ssl_ca_certificate, ssl_client_certificate, and
ssl_client_key changed even though the field names didn’t. Now these assets are saved directly
in the database instead of on the filesystem, and they are prevented from being read back out to
users after being set for security reasons. This was done with these changes.