##- Please type your reply above this line -##

[Linaro IT Services] Update: Re: [GIT PULL] KVM patches for LSK 3.14

You are registered as a CC on this support request (linaroithelp.zendesk.com/requests/3546). Reply to this email to add a comment to the request.

----------------------------------------------

Paul Sokolovsky, Oct 15 23:45

On Mon, 13 Oct 2014 11:03:09 +0000 "Benjamin Copeland (Linaro IT Services)" its@linaro.org wrote:

Hello Christoffer, Mark, Jon,

Sorry, these are weird issues, which is hard to debug post-factum. As the matter was about /git-ro/ (dump git protocol), the likely cause is indeed "git update-server-info" haven't been run. Running it is however handled by gitolite, via post-update hook. So, how could it happen it didn't run? Well, unfortunately we saw such cases in the past. We tried to debug them (e.g. I remember adding logging to update hook), but as it's pretty lurky thing, we didn't had much success with it. Suffice to say that under some circumstances (heavy load) process creation in Linux can fail, and knowing that git servers are under regular load, that seems to be it.

Instead, for android.git.linaro.org, we went to add 2nd layer of reliability - run "git update-server-info" via cron too. I checked and see that git.linaro.org lacks this cronjob, so let me know if you'd feel more comfortable with it.

But as Ben already mentioned, the suggested solution is to use smart HTTP protocol (URLs w/o /git-ro/). /git-ro/ is still listed in the gitweb just to offer people a choice in case of issues or peculiar circumstances, but otherwise on a gitweb page like https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git clone URLs are listed in the order of suggested use preference.

Hope that clarifies the situation, and feel free to ping me (pfalcon) directly on IRC if you spot anything like that again, so I can see what's up while it's hot.

Thanks!

----------------------------------------------

Benjamin Copeland, Oct 13 12:03

Hi Mark,

cc'ing in Systems team.

Thanks

Ben

----------------------------------------------

Mark Brown, Oct 10 19:28

Hi,

Or we're doing the git server-info update in cron rather than from a push hook so it's taking a while for the update to be done?

Thanks,

Mark

----------------------------------------------

Jon Medhurst (Tixy), Oct 10 18:56

I believe I may also hit a similar problem in the past, see http://lists.linaro.org/pipermail/linaro-kernel/2014-August/016842.html

On my next pull request, I also saw the issue of the commit I had pushed apparently not being seen by git request-pull, but after waiting until the next day I found it was.

Perhaps there is some caching going on which means that some (gitolite?) operations are seeing old data?

On Fri, 2014-10-10 at 16:58 +0000, Mark Brown (Linaro IT Services) wrote:

----------------------------------------------

Mark Brown, Oct 10 17:59

Hi Ben,

You need to tell Christoffer that, not me - he's the one sending the pull request. If you don't want people using the -ro URL I'm not sure why it's being advertised?

Thanks,

Mark

----------------------------------------------

Mark Brown, Oct 10 17:58

Hi,

You're missing the use case here - nobody is trying to clone the repository. I'm trying to do a git pull which means fetching a specific tag/branch from the repository. It does seem that this is working now, I guess that some update was made which fixed that (perhaps the fsck?).

Thanks,

Mark

----------------------------------------------

Benjamin Copeland, Oct 10 16:45

Also, I forgot to add you are using git-ro. This is the dump protocol, you should use /git/, which should be the smart HTTP protocol.

The dump protocol downloads one file at a time. The smart protocol is much faster.

You can change the remote url after cloning.

git remote set-url origin "https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git"

Obviously, make sure you push on the ssh protocol.

Thanks

Ben

----------------------------------------------

Benjamin Copeland, Oct 10 16:18

I just cloned it locally to see how well it performs.

Receiving objects: 100% (4234099/4234099), 1008.11 MiB | 13.85 MiB/s, done. Resolving deltas: 100% (3549840/3549840), done. Checking connectivity... done. Checking out files: 100% (47500/47500), done. git clone https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git 131.89s user 36.25s system 66% cpu 4:11.53 total

131.89s is pretty good for 1.8G.

Anyway, I was able to clone it fine. You can run git fsck "locally", I would advice this first and maybe to clone it from fresh. It sounds like you have corrupted repositories locally.

Thanks

Ben

----------------------------------------------

Mark Brown, Oct 09 17:58

On Wed, Oct 08, 2014 at 09:36:42PM +0100, Mark Brown wrote:

On 8 October 2014 16:23, Christoffer Dall christoffer.dall@linaro.org

...

http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:

I tried to pull this but:

$ git pull http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1 error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034

Just worked for me (although it took ages).

Alternatively all the commits should be available here too:

https://github.com/chazy/linux-kvm-arm.git

It's still broken for me with HTTP, I changed to git which worked a lot better (it was easier than cut'n'pasting the URL). Looks OK - will throw into the existing testing & see.

----------------------------------------------

christoffer.dall, Oct 09 10:18

On Wed, Oct 08, 2014 at 09:36:42PM +0100, Mark Brown wrote:

On 8 October 2014 16:23, Christoffer Dall christoffer.dall@linaro.org wrote:

...

are available in the git repository at:

http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:

I tried to pull this but:

$ git pull http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1 error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034

Just worked for me (although it took ages).

Alternatively all the commits should be available here too:

https://github.com/chazy/linux-kvm-arm.git

-Christoffer

----------------------------------------------

christoffer.dall, Oct 09 09:55

Hi Luka,

There's clearly something broken in our setup, because I can see the commit in that repo here:

https://git.linaro.org/people/christoffer.dall/linux-kvm-arm.git/commit/d731...

I am trying the pull and clone myself too, but from two different machines/networks (one in Copenhagen, one in Canada) it takes forever to get any data from the server. Is that server healthy? Can you run 'git fsck' on the repo? (please be careful not to mess it up)

Thanks,

-Christoffer

----------------------------------------------

Luca Sokoll, Oct 09 06:26

Hey Mark,

You say they're available but I don't see them in the git repo you specified. Where are you seeing them available?

I SSH'd onto the git server and searched for that particular file and there was nothing found. Is it typed correctly?

Thanks, Luca

----------------------------------------------

Mark Brown, Oct 08 21:36

On 8 October 2014 16:23, Christoffer Dall christoffer.dall@linaro.org wrote:

are available in the git repository at:

http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

for you to fetch changes up to d731c6c9b17b8a6b471981b3e310235049190034:

I tried to pull this but:

$ git pull http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git kvm-for-lsk-v3.14-v1

error: Unable to find d731c6c9b17b8a6b471981b3e310235049190034 under http://git.linaro.org/git-ro/people/christoffer.dall/linux-kvm-arm.git

Cannot obtain needed commit d731c6c9b17b8a6b471981b3e310235049190034

-------------------------------- This email is a service from IT Services.

[JJAM-RB85]