Can we make sure that the issue #3989 doesn't affect any migrated project?

[praiskup]

Not sure if we'll need that in the future, but I'd bet yes? See #3989

This affected @copr/copr-dev -- and it was very hard to chase. Can we have a script that would list PULP projects, and the projects in Copr-frontend, and check the consistency?

[praiskup]

That particular issue is fixable by toggling manual createrepo on and off again. But we need a way to realize this problem even exists.

[FrostyX]

I created this script and put it to /usr/local/bin/copr-regenerate-button-bug.py.

from urllib.parse import urlencode
from copr_backend.pulp import PulpClient
from copr.v3 import Client, CoprNoResultException


def get_all_distributions(client):
    all_results = []
    offset = 0
    limit = 100
    while True:
        pagination = {"offset": offset, "limit": limit}
        uri = "/api/v3/distributions/rpm/rpm/?"
        uri += urlencode(pagination)
        response = client.send("GET", uri)
        response.raise_for_status()
        data = response.json()
        all_results.extend(data["results"])

        next_url = data.get("next")
        if not next_url or len(data["results"]) == 0:
            break

        offset += limit
    assert len(all_results) == data["count"]
    return all_results


def manual_createrepo_enabled(client, owner, project):
    try:
        copr = client.project_proxy.get(owner, project)
        return copr.devel_mode
    except CoprNoResultException:
        # Comment out for local dvelopment
        raise
        return False


def main():
    pulp = PulpClient.create_from_config_file()
    copr = Client.create_from_config_file()

    distributions = get_all_distributions(pulp)
    for distribution in distributions:
        print("Checking: {0}".format(distribution["name"]))

        # Those are mutually exclusive but to be sure, check both
        # Standard, non-manual-createrepo projects needs to have their
        # repository set and publication not set
        if distribution["repository"] and not distribution["publication"] :
            continue

        owner, project, _chroot = distribution["name"].split("/")
        if ":" in project:
            project = project[:project.find(":")]

        if not manual_createrepo_enabled(copr, owner, project):
            continue

        print("Distribution {0} is broken".format(distribution["name"]))


if __name__ == "__main__":
    main()

I think no other projects are broken.

[nikromen]

this is basically confirmed that this can't happen again