# Pods Deployed Using Multus Plugin Fail to Have Container Added to Network After Upgrading to Whereab

## Problem

It is observed that the stateful sets pods were failing to come up with the below error.

{% tabs %}
{% tab title="Javascript" %}

```javascript
Warning  FailedCreatePodSandBox  4m31s (x1188 over 7h15m)  kubelet  (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2aaXXXXXXXXXXXXXXXXX42": plugin type="multus" name="multus-cni-network" failed (add): [signaling-cvi/sip-frontend-0:mirror-dhcp-vlan-372-10.165.186.128-25]: error adding container to network "mirror-dhcp-vlan-372-10.165.186.128-25": error at storage engine: k8s get error: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline
```

{% endtab %}
{% endtabs %}

Cluster is upgraded to K8s v1.24, new job pods for the ip-reconciler cronjob were unable to start.

{% tabs %}
{% tab title="Javascript" %}

```javascript
$ kubectl get jobs -n kube-system | grep ip-reconciler
ip-reconciler-28333105                1/1           8s         16d
ip-reconciler-28333110                1/1           8s         16d
ip-reconciler-28333115                1/1           8s         16d
ip-reconciler-28357405                0/1           3m31s      3m31s
```

{% endtab %}
{% endtabs %}

A manual run of the job produced an error with regards to file not being present in the container image, e.g.

{% tabs %}
{% tab title="Javascript" %}

```javascript
7s         Warning   Failed                 pod/ip-reconciler-manual-bkxwd                Error: failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "/ip-reconciler": stat /ip-reconciler: no such file or directory: unknown
```

{% endtab %}
{% endtabs %}

Image: [docker.io/platform9/whereabouts:v0.6-pmk-6](http://docker.io/platform9/whereabouts:v0.6-pmk-6)

{% tabs %}
{% tab title="Javascript" %}

```javascript
Command:
      /ip-reconciler
      -kubeconfig=/host/etc/cni/net.d/whereabouts.d/whereabouts.kubeconfig
```

{% endtab %}
{% endtabs %}

## Environment

* Platform9 Managed Kubernetes - v5.6 and Higher
* Managed Platform9 Edge Cloud - v5.6 and Higher.

## Answer

This is a know issue, Platform9 has a jira filed AIR-1268 to track and provide a permanent solution for this issue.

## Workaround

The workaround is to patch the `networkplugins.plumber.k8s.pf9.io` CRD for the K8s cluster associated with respective management plane to use the Whereabouts v0.4.10 image.

{% tabs %}
{% tab title="Javascript" %}

```javascript
# kubectl patch networkplugins networkplugins-devtestcluster -n <NAMESPACE> --patch '{"spec": {"plugins": {"whereabouts": {"whereaboutsImage": "docker.io/platform9/whereabouts:v0.4.10"}}}}' --type merge -o yaml
```

{% endtab %}
{% endtabs %}

## Additional Information

To track progress of the permanent solution for this issue, open a support ticket mentioning the jira ID AIR-1268.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://platform9.com/kb/pmk/frequently-asked-questions/pods-deployed-using-multus-plugin-fail-to-have-container-added-t.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.