Community Handover

Owned by Nils Semmelrock
Last updated: Mar 13, 2023 by Lars Kreutzer
6 min read

This page tracks the progress for the on-going community handover. This is a living document that will be updated regularly. You can find the related board at https://github.com/orgs/magma/projects/18/views/1.

Note: not all planned issues tracked in our board are yet displayed here.

Status - Done, In Progress, Planned

(On issue/PR level: done, in progress, planned)

  • DevOps Handover

    • DONE Handover DevOps Monthly Chair

    • In Progress General documentation

      • #14828 CI documentation is improved

      • #14324 Update/remove outdated CI documentation

      • #14919 Complete "Technical Infrastructure" page

      • #14922 Document third-party dependencies

      •  #14939 Expand documentation on how to update versioned docs

      •  #14956 Remove unused Tutorials section from sidebars

      • #14964 Add NMS page to sidebar

      • #14972 Remove unused AGW subsection from sidebars

      • #14975 Clean up NMS architecture page in sidebars

      • #14979 Fix ids of two proposals so they appear in sidebars

      • #15017 Add FeG docker page to sidebars

      • #15018 Add missing CWF pages to sidebars

      • #15008 Add documentation about using new VM base images

      • #14246 Improve proper CI integration of https://magma-ci.web.app/

    • In Progress Release documentation - based on last release, but there were a lot of changes (cloud artifactory, etc.)

    • Needed Codeowners from community needed

    • Release

      • #14696 a debian promote workflow for releases is created

    • Fix imminent CI issues

      • #14763 #14764 #14765 #14766 Change remote location of liblfds

        • #14945 Backport to v1.8 branch

      • #14860 CI: Investigate failure of insync check Orc8r Check Generated Files In Sync

      • #14934 Fix envoy_controller link for integ tests

      •  #14901 Fix pylint job by running apt update

      • #14850 Investigate silently failing wemake-python-styleguide

      • #15129 Fix out of space error for Bazel Docker cache build

      • #15128 Unblock CI by skipping broken NMS tests

  • Make builds more robust - prevent software decay

    • Upgrade outdated tooling

      • In Progress fabric

      • Planned cpp redis

        • #8321 bettereng: update cpp_redis version

      • Planned here are a lot more construction sites

    • Make CI more robust

      • DONE Various stabilization and QoL efforts to integration tests (docker + debian artifact)

        • Planned more options are possible if wanted

        •  #14124 CI support for dockerized agw fix tests that do not run out of the box on ci

        • #14745 CI runs triggered by repository_dispatch get the correct SHA assigned

        • #14790 Fix flakieness of sudo test test_inout_non_nat in pipelined

        • #14798 Add default values to "AGW Test LTE Integration With Make Containerized Build"

        • #14799 feat(ci): execute long extended tests in CI run

        • #14812 chore: containerized integ test results are published

        • #14813 chore: integ tests always wait for pipelined

        • #14736 Simplify message handling sent to Slack

        • #14228 Investigate state of agw-docker-load-test.yml

        • #14349 Remove test duplication in feg radius

        • #14874 chore: cwag c images are build based on cached bazel image

        • #14820 chore: envoy service is started for containerized integ tests

        • #14870 fix: old digest is compared with new digest of helm dependencies

        •  #14784 feat(ci): enable publishing to Vagrant Cloud without user interaction

        •  #14946 fix(agw): restart mme as a single service for one single containerized AGW integ test

        •  #14992 Require codeowner for go.mod changes

        •  #14783 Limit docker output in CI

        •  #14950 fix: flaky mvn search api call is prevented by setting openapi cli version by a workaround

        •   #14829 VMs are sometimes not starting properly in CI

        • #13915 magma deployment works with latest ansible version

        • #14283 Make messages sent to Slack homogeneous

        • #14470 Upgrade actions/github-script to recent stable version

        • #14558 Outdated Github Actions using node version 12

        • #14624 Fix artifactory publishing for old releases

        •  #14792 Segmentation fault in integration test runs is fixed

        • #14866 Upgrade GitHub actions workflow runners

        • #14903 Use bazel-base image as basis for Bazel builds in Dockerfiles

      • DONE Pylint workflow + Pylint fixes

        • #14741 make sure pylint_tests.py runs in ci

      • DONE Federated Integration tests

        •  

          • #14839 optimize federated integ tests

      • DONE Update base images

      • DONE Improve Python typing

        •  

          • #14889 Address mypy errors in lte/gateway/python

          • #14884 Address selection of mypy errors in orc8r/gateway/python

          • #14896 Modify mypy configuration

          •  #14929 Remove `fail_on_error: true` from mypy step in CI

    • In Progress General code and build improvements

      • #14705 Broken Python CLI scripts inside the containerized AGW

      • #14769 chore: mme compile warnings are reduced

      • #12435 migrate NamedTuple usage to look nicer

      • #14707 Empty error messages in Go HTTP endpoints

      • #14348 Apply linter autoformat to all documentation

      •  #14248 Clean up pinning of golang.org/x/tools v0.1.12

      •  #14931 Clean up C and CPP formatting

      • #14967 Update information relevant to the PR Generate Hello workflow

      • #15043 Remove dead code from orc8r/gateway/docker

      • #15117 Add license headers to Dockerfiles

      •  #12076 Remove unused dpi code from pipelined

      • #12754 Move python module code to script folders

      • #14358 libfolly-dev build for arm is fixed

      • #13847 Find a solution to build debian packages for modern Python libraries

      • #13606 AGW production scripts are analyzed

      • #14748 Fix receiving wrong ARP packets in pipelined

      • #14818 Analyze performance regression of gw_mac_address.py

      • #15000 Refactor Python precommit Docker setup

      • #14999 Fix Python pep8 regressions

      • #14977 Fix all C-style casting warnings

      • #14965 Create CI job to check that the docusaurus IDs and file names are in-sync

      • #14904 Move clang format into shell script

      • #14840 Fix remaining markdown formatting issues in the entire repository

      •  #14876 Create LTE integ test workflow that builds services from scratch

  • Bazel Handover

    • DONE  general issues

      • #14709 Make package conflicts explicit

      • #14793 Modify run_buildifier.sh to not use MAGMA_ROOT

      • #14851 Release Bazel services for Sentry

      • #13936 Investigate bazel production build GCC optimisation level

      • #14793 Do not use MAGMA_ROOT in Starlark format script

      •  #14858 Build MME with Bazel for build-containers workflow

      • #14912 Run integ tests directly "without" Make

      • #14900 Add comments to BUILD file to explain the difference between agw_of vs mme_oa

      • #14839 Use Bazel-built Magma Debian package in FEG integ test workflow

      • #15072 Build the Python services with Bazel for the Dockerized AGW

      • #15103  Build the Python services with Bazel for the FEG Docker images

      • #15116 Update the Python bazelification check

      • #15041 Build the Python services with Bazel for CWF Docker images

      • #15137  Disable Make AGW Debian build and integ tests

      • #15144 Remove AGW Make workflows for the AGW Bazel switchover

    • mitigate AWS shut down

      •  

        • #14690 Clean up all code related to remote caching once the cache is switched off

        • #14796 Tear down the bazel remote cache with Terraform

    • DONE Documentation

    • In Progress Handover to community

      •  #15005 Create deprecation warning for AGW Makefiles 

      • #14835 Make to Bazel switchover for the AGW (Clean-up to be merged by the community)

    • Bazel Issues to be handled by the community (maintenance, clean-up, optional, ...):

      •  #15101 Clean up tasks for after the Bazel to Make AGW switch-over

      •  #14791 Upgrade to bazel 6

      • #14359 make-only dependencies in the devcontainer are removed

      •  #15006 Create CI check to detect new AGW Make targets

      • #14746 Install LTE AGW to an isolated location

      • #14318 Create CI job for running the load tests

      • #13358 S1AP tests (itests) are Bazelified - CLOUDTESTS

      • #13364 Bazel dependency meta info is centralized

      • #14027 Analyze commented out integration tests

      • #13563 Analysis: Why do 41 python tests fail with --config=production?

      • #13521 Analysis: Can bazel-built proto sources be used for the envoy_controller?

      • #13850 protobuf/grpc uses pre-build binaries

      • #14274 Investigate using GH native docker run action instead of addnab/docker-run-action

      •  #14885 Investigate differences in versions and origin of dynamically linked libraries for MME

  • Process Preparations

    • In Progress Simplification and clean-up of codeowner groups

      •  #14822 Codeowner Groups are Simplified

  • Make sure 1.7 and 1.8 are in a good state

    • In Progress Analyze reported problems

      • #14937 Ensure functionality of Bazel workflows on v1.8 branch

      • general activity in slack and reported bug issues

      • #14837 403 Forbidden during debian install from LF repository

      • #14955 Update GitHub actions that use node version 12 for the release branch v1.8

      • #14954 Update Github's deprecated save-state and set-output commands for v1.8 release branch

    • In Progress Test artifacts

      • #14873 Check 1.8.0 release branch for regression

  • Important issues to be handled by the community:

    •     #14835 Clean up the AGW Make targets after the Bazel switch-over

    •     #14558 Outdated Github Actions using node version 12 (due by Summer 2023)

    •     #14955 Update GitHub actions that use node version 12 for the release branch v1.8 (due by Summer 2023)

    •     #14624 Fix artifactory publishing for old releases

    •     #14396 [AGW + Orc8r] Finalize EPS authentication flow: Document the feature, add integration tests

    •     #13249 [AGW + Orc8r] Replace subscriberDB streaming when EPS authentication service is active

    •     #13251 [orc8r] Turn off subscriber data streaming from Orc8r when CloudSubscriberdbEnabled is set to true

    •     #14792 Segmentation fault in integration test runs is fixed

    •     #14866 Upgrade GitHub actions workflow runners