Paul Sokolovsky

Oct 15 23:45

On Mon, 13 Oct 2014 11:03:09 +0000
"Benjamin Copeland (Linaro IT Services)" <its@linaro.org> wrote:

Hello Christoffer, Mark, Jon,

Sorry, these are weird issues, which is hard to debug post-factum. As
the matter was about /git-ro/ (dump git protocol), the likely cause is
indeed "git update-server-info" haven't been run. Running it is however
handled by gitolite, via post-update hook. So, how could it happen it
didn't run? Well, unfortunately we saw such cases in the past. We
tried to debug them (e.g. I remember adding logging to update hook),
but as it's pretty lurky thing, we didn't had much success with it.
Suffice to say that under some circumstances (heavy load) process
creation in Linux can fail, and knowing that git servers are under
regular load, that seems to be it.

Instead, for android.git.linaro.org, we went to add 2nd layer of
reliability - run "git update-server-info" via cron too. I checked
and see that git.linaro.org lacks this cronjob, so let me know if you'd
feel more comfortable with it.

But as Ben already mentioned, the suggested solution is to use smart
HTTP protocol (URLs w/o /git-ro/). /git-ro/ is still listed in the
gitweb just to offer people a choice in case of issues or peculiar
circumstances, but otherwise on a gitweb page like
https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git clone
URLs are listed in the order of suggested use preference.

Hope that clarifies the situation, and feel free to ping me (pfalcon)
directly on IRC if you spot anything like that again, so I can see
what's up while it's hot.

Thanks!

Benjamin Copeland (IT Services)

Oct 13 12:03

Hi Mark,

cc'ing in Systems team.

Thanks

Ben

Mark Brown

Oct 10 19:28

Hi,

Or we're doing the git server-info update in cron rather than from a push hook so it's taking a while for the update to be done?

Thanks,

Mark

Jon Medhurst (Tixy)

Oct 10 18:56

I believe I may also hit a similar problem in the past, see
http://lists.linaro.org/pipermail/linaro-kernel/2014-August/016842.html

On my next pull request, I also saw the issue of the commit I had pushed
apparently not being seen by git request-pull, but after waiting until
the next day I found it was.

Perhaps there is some caching going on which means that some (gitolite?)
operations are seeing old data?

On Fri, 2014-10-10 at 16:58 +0000, Mark Brown (Linaro IT Services)
wrote:

Mark Brown

Oct 10 17:59

Hi Ben,

You need to tell Christoffer that, not me - he's the one sending the pull request. If you don't want people using the -ro URL I'm not sure why it's being advertised?

Thanks,

Mark

Mark Brown

Oct 10 17:58

Hi,

You're missing the use case here - nobody is trying to clone the repository. I'm trying to do a git pull which means fetching a specific tag/branch from the repository. It does seem that this is working now, I guess that some update was made which fixed that (perhaps the fsck?).

Thanks,

Mark

Benjamin Copeland (IT Services)

Oct 10 16:45

Also, I forgot to add you are using git-ro. This is the dump protocol, you should use /git/, which should be the smart HTTP protocol.

The dump protocol downloads one file at a time. The smart protocol is much faster.

You can change the remote url after cloning.

git remote set-url origin "https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git"

Obviously, make sure you push on the ssh protocol.

Thanks

Ben

Benjamin Copeland (IT Services)

Oct 10 16:18

I just cloned it locally to see how well it performs.

Receiving objects: 100% (4234099/4234099), 1008.11 MiB | 13.85 MiB/s, done.
Resolving deltas: 100% (3549840/3549840), done.
Checking connectivity... done.
Checking out files: 100% (47500/47500), done.
git clone https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git 131.89s user 36.25s system 66% cpu 4:11.53 total

131.89s is pretty good for 1.8G.

Anyway, I was able to clone it fine. You can run git fsck "locally", I would advice this first and maybe to clone it from fresh. It sounds like you have corrupted repositories locally.

Thanks

Ben

Mark Brown

Oct 09 17:58

On Wed, Oct 08, 2014 at 09:36:42PM +0100, Mark Brown wrote:
> On 8 October 2014 16:23, Christoffer Dall <christoffer.dall@linaro.org>

> > http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> > kvm-for-lsk-v3.14-v1
> >
> > for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:
> >
>
> I tried to pull this but:
>
> $ git pull
> http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> kvm-for-lsk-v3.14-v1
> error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under
> http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034

Just worked for me (although it took ages).

Alternatively all the commits should be available here too:

https://github.com/chazy/linux-kvm-arm.git

It's still broken for me with HTTP, I changed to git which worked a lot better (it was easier than cut'n'pasting the URL). Looks OK - will throw into the existing testing & see.

christoffer.dall

Oct 09 10:18

On Wed, Oct 08, 2014 at 09:36:42PM +0100, Mark Brown wrote:
> On 8 October 2014 16:23, Christoffer Dall <christoffer.dall@linaro.org>
> wrote:
>
>
> > are available in the git repository at:
> >
> > http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> > kvm-for-lsk-v3.14-v1
> >
> > for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:
> >
>
> I tried to pull this but:
>
> $ git pull
> http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> kvm-for-lsk-v3.14-v1
> error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under
> http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git
> Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034

Just worked for me (although it took ages).

Alternatively all the commits should be available here too:

https://github.com/chazy/linux-kvm-arm.git

-Christoffer

christoffer.dall

Oct 09 09:55

Hi Luka,

There's clearly something broken in our setup, because I can see the commit in that repo here:

https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git/commit/d731c6c9b17b8a6b471981b3e310235049190034

I am trying the pull and clone myself too, but from two different machines/networks (one in Copenhagen, one in Canada) it takes forever to get any data from the server. Is that server healthy? Can you run 'git fsck' on the repo? (please be careful not to mess it up)

Thanks,

-Christoffer

Luca Sokoll (IT Services)

Oct 09 06:26

Hey Mark,

You say they're available but I don't see them in the git repo you specified. Where are you seeing them available?

I SSH'd onto the git server and searched for that particular file and there was nothing found. Is it typed correctly?

Thanks,
Luca

Mark Brown

Oct 08 21:36

On 8 October 2014 16:23, Christoffer Dall <christoffer.dall@linaro.org> wrote:

are available in the git repository at:

http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:

I tried to pull this but:

$ git pull http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git

Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034