18:59:41 #startmeeting 18:59:41 Meeting started Wed Aug 14 18:59:41 2019 UTC. The chair is waldi. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:59:41 Useful Commands: #action #agreed #help #info #idea #link #topic. 18:59:50 #chair serpent_ 18:59:50 Current chairs: serpent_ waldi 19:00:03 waldi, serpent_: wfm :-) 19:00:07 How does bot work? 19:00:21 magically :-) 19:00:22 serpent_: https://wiki.debian.org/MeetBot 19:01:30 Thanks 19:01:48 Let's start. I guess the most important topic for now is sprint 19:02:06 #info Sprint at MIT 19:02:14 #topic Debian Cloud Sprint 2019 19:02:44 It looks like the only safe date for now is 2019-10-14 till 2019-10-16 19:03:03 Those dates work for me. 19:03:04 We have reserved rooms, and the only person (that I know about) who cannot come is Bastian 19:03:15 waldi: could you join remotely? 19:03:22 at least for a while? 19:03:41 2019-09-30 till 2019-10-02 slot is gone (room already reserved by someone else) 19:04:11 noahm: i found a way to make it work and join you at MIT 19:04:21 Cool! 19:04:26 great 19:04:50 So can we set this dates and start preparing (i.e. buying plane tickets, reserve hotels, etc.)? 19:05:10 I'll attend as best I can over IRC 19:05:13 tho right now I'm not sure if I can make it, but in the worst case I'll try to join remotely 19:05:24 #info No objections for dates 2019-10-14 till 2019-10-16 19:05:41 #agreed Sprint 2019 will be at MIT from 2019-10-14 till 2019-10-16 19:05:55 #info kuLa is not sure, but in worst case he'll be on IRC (or other way) 19:06:52 #action I'll get paperwork with DPL to get sponsorship and similar 19:06:56 I guess we should look for travel costs and send them until $date to serpent_ so you can sum all costs and ask DPL for aproval of costs? 19:07:06 Exactly 19:07:40 Please send me info about costs. I'll ask Sledge and Sam how to do this properly, according to all rules 19:07:43 any proposal for the hotel? 19:07:53 Any local people? 19:08:17 can you provisionally count me in pls, I'll try to confirm asap if I'm able to attend in person or not 19:08:23 As we are 2 months before sprint, we could try to reserve more rooms, and possibly share them to save costs. 19:08:34 Sam works next to MIT, afaik :P 19:08:37 kuLa: OK 19:08:40 I'm formerly local and can provide some help. jproulx is local and can also help with things. 19:09:28 I guess the most urgent thing is to know how many people will come (please send emails!) and then we can try to reserve hotel rooms. 19:10:32 yes 19:10:37 Does anybody object sharing rooms? 19:11:12 no, except with snoring people 19:11:23 serpent_ we should send you all the information on this email: serpent@debian.org? 19:11:27 Or if anyone has special needs (i.e. arriving earlier, leaving later) please put this info in email 19:11:42 Yes, that's the best solution 19:11:51 ack 19:12:35 For snoring - does anyone know if we can get sponsorhip for work-grade ear protectors ;-) 19:12:54 :P 19:13:17 serpent_: the simple ones are not enough? 19:13:41 people who are sensitive to snoring can sleep next to the white-noise source that is MIT's OpenStack installation. 19:13:48 #action Please send me the info about travel/hotel (and if Debian sponsorship is required) to serpent@debian.org 19:13:50 serpent_: just to be sure, what all details would you need? 19:14:03 Ah, got it :) 19:14:57 Arrival and departure dates, for how many (and which) dates you need hotel, and costs of those if you apply for Debian support 19:15:16 concerning food sponsorship: IIRC Jonathan said we need sponsors for food. 19:15:20 If not - (i.e. your comapny or someone else will pay) - you don't need to send this info for me 19:15:41 #action I'll update our wiki page with dates of spring 19:15:44 Ack, thanks. 19:16:35 I'll probably need some help from Sledge (as he was dealing with this previous time) but AFAIK this was info we was gathering 19:16:59 Then all other details (scans of receipts, etc.) you'll need to send to SPI 19:17:03 serpent_: I think I can help as well I was doing this for 2 sprints 19:17:24 Cool - I'll send email to you and Sledge (probalby tomorrow or so) 19:17:37 ack 19:17:50 So - what do we plan to do on sprint, or even before? 19:18:30 I think we can build a sprint agenda on the wiki. Unless anybody really has anything that needs to be discussed here now. 19:18:33 I guess the most important is to spread the knowledge so more than one person knows how to build and publish images 19:19:06 People should use our tool in their environment. Then we will see what needs more documentation. 19:19:13 * kanashiro waves o/ 19:19:41 Mrfai: even within the cloud team, not a lot of people know how the salsa pipelines work. 19:19:48 kanashiro: o/ 19:19:48 I think that's what serpent_ is getting at. 19:19:49 noahm: agreed, but we can also discuss it here while everyone is here 19:20:02 Exactly 19:20:40 * kanashiro is reading the backlog 19:20:42 #action We need (should?) put sprint agenda on the wiki 19:20:49 ack 19:21:15 And as you most probably know, Sledge has resigned from being delegate. 19:21:30 should we nominate a replacement? 19:21:33 and we probably need a 3rd one :-) 19:21:41 +1 to what noahm said 19:21:59 Sam (DPL) has not yet sent updated delegation, but we should discuss it; possibly before but the best in person during sprint 19:22:16 wfm 19:22:18 Sledge also mentioned that Luca has been busy, so we probably need more delegates 19:22:55 we don't have a lot of possible candidates 19:22:58 Yes - but it's still good to have someone from SPI involved as now accounts are under their control 19:23:01 who is keen on jumping on it? 19:23:26 as a delegate I mean 19:23:57 We don't need to decide now, but think about it 19:23:58 serpent_: SPI does not have any access to those accounts, nor have they asked. it just gives the name for now 19:24:19 OK - then it's another item 19:24:33 we should think about it and discuss during the sprint 19:24:41 serpent_: I know tho would be nice if ppl start thinking about nominations 19:24:42 #action Discuss during sprint how accounts are managed 19:25:33 That's what I mean - let's think about it, and let unconciousness (hi Freud!) work on it 19:28:01 next topic? 19:29:18 Image finder? 19:29:26 May I suggest: status of accounts, in particular the AWS account(s)? 19:29:35 OK 19:29:42 #topic Status of accounts 19:29:57 AWS accounts are still lost in the beureaucratic maze of AWS administration. 19:30:12 I'm trying to get the matter escalated. 19:30:22 Is there anything that anyone can do to help? 19:30:34 which means we currently only have our legacy jeb owned account 19:30:34 serpent_: yes, I'd love to see the status of the image finder 19:30:50 If you're an AWS customer, you could contact your support channels and complain about buster not being available. 19:31:12 That helps get the fire going under the right people 19:31:34 noahm: I can definitely do that. Any names or departments worth mentioning to get it escalated to the right place? 19:32:49 Mention that you've raised the issue with Debian and that the issue needs to be addressed through the AWS OS partners integration team. 19:33:04 I'll get onto it, thanks noahm 19:33:17 About the image finder on debconf BoF we talked about the remain features to have a complete project and that feature was Token-based authentication. Now its just a matter of review and aprove this feature to master https://salsa.debian.org/cloud-team/image-finder/merge_requests/39 19:33:22 Other accounts are OK? 19:33:38 the Azure migration is completed 19:33:42 arthurbdiniz, image finder should be the next topic :) 19:33:43 I mean Azure and GCE? 19:33:48 we did nothing for google yet 19:34:15 Regarding the old jeb account, we have a goal of migrating our CloudFront (CDN) deployment from that acct to one of the new ones eventually. 19:34:16 Do we need to do anything for Google? 19:34:16 So Azure is finished, AWS is stuck on Amazon side, GCE is not started? 19:34:29 yes 19:34:36 But we aren't able to work on that until the new acct is set up. And I don't know who's actually going to do that work. 19:34:58 I have a quick Q, there is a access request to salsa cloud group from Utkarsh Gupta @utkarsh2102-guest and I think this is a 2nd attempt as it previously was denied (I think) any ideas why and if we should grant access? 19:35:02 Is there something that we need from Debian side, SPI side, or Google side? 19:35:20 noahm: I think it was jimi and luca, tho both are v busy atm 19:35:43 kuLa: I am here. You may ask if you want to ask anything about it :) 19:35:44 for GCP I think we need SPI and G 19:35:54 kuLa: i would like to see some contributions first 19:35:59 yeah. The CDN something I'd be interested in working on as well, but I am also busy... 19:36:36 It would be great to work out (with jimi and luca?) how to get it handed over and progressed, then. 19:36:39 kuLa: for google we need to decide what we exactly want. the doing should be easy as soon as we figured this ou 19:36:42 noahm: CDN on AWS or GCP? if on AWS jcristau is your man as he set it up 19:36:55 kuLa: AWS specifically 19:37:14 noahm: the global loadbalancer stuff? 19:37:26 I guess we agreed to have mirrors on all 3 providers? 19:37:40 Or are you talking about something else with CDN? 19:37:41 It would be great to get the config into CloudFormation if it's not already, etc... That's something I can help with (CFN and AWS in particular) 19:37:41 waldi: the cloudfront component of it, anyway, if not the global LB 19:38:09 noahm: cloudfront is nasty stuff. i myself wanted to look at the aws global lb stuff 19:38:23 we are straying from the current topic. :) 19:38:24 serpent_: yes, we did, sort of 19:38:35 If I remember existing solutions, it was mostly Terraform and Ansible. But no more details 19:38:42 maybe a new one: cloud provider package distribution network? 19:38:49 I think from GCP we need our own org so we can control access and possibly do SAML 19:39:05 kuLa: we have SPI's org, this works 19:39:19 debian salsa is using it a lot 19:39:20 serpent_: yes it was TF as I wrote it and handed to DSA 19:39:23 We might need separate email thoug 19:40:04 I haven't seen any commits to those repos recently, so it's still TF :-) 19:40:48 waldi: is G taking care of the bill for this if so and if delegates can be owner I think we're ok 19:41:37 kuLa: in the salsa case, G is sponsoring "money" on a billing account we, the salsa admins, have access 19:42:03 utkarsh2102[m]: do you have any code you'd like to be merged to any of the team repos? 19:42:38 waldi: sure but is it via credits or via billing account belonging to G? 19:42:47 via credits 19:43:22 So what's the issue/situation with G account right now? 19:43:48 AWS account belonged to jeb, Azure to Credativ - that's why we had to get new ones 19:44:36 IIRC G owns the debian-images project where they're published from 19:45:40 I'm not sure how Hydroxide and zack envisiged this but I think if we got org with billing acc associated with G for picking up bills it'd be great if not we need to set up billing acc as it's done for salsa and chase G for credits now and then which looks suboptimal for me 19:47:09 didn't we discuss about how to create those accounts during the last sprint? 19:47:27 Yes, but somehow it got lost in the works 19:47:46 so we have a plan, we need to implement it 19:48:07 AFAIR ball was on side or cloud providers (as now is with AWS) or SPI 19:48:28 But both people closest to SPI (Jimmy and Luca) are quite busy right now 19:49:45 kuLa: I was trying to update a couple of issues under team repo, but couldn't. Had packaged the dependencies for the cloud-finder recently. 19:50:26 But if waldi wants to see some code contributions first, then that is fine as well. 19:51:49 Is it really needed to contribute before becoming a member? 19:52:36 Are we finished with accounts? We don't have any closure, but I guess we can continue on ML, during next meeting, or during Sprint 19:52:50 yes, please 19:54:02 I was trying to find action plan for GCP in the notes from 2018 sprint but looks like there is nothing special there 19:55:27 do we have more topics? 19:55:28 We didn't have anything specific for account 19:55:32 waldi: the images being generated for publication by CI on salsa are based on the master branch, right? 19:56:03 noahm: yes. and as long as we don't have breaking changes i would like to continue this 19:56:11 more about user integration and so on, but it depends on accounts under our (Debian/SPI) control 19:56:16 I think we should branch. 19:56:21 It'd be best if dev work doesn't risk breaking stable images. 19:56:44 E.g. if we want to introduce changes to the list of installed packages, that'll come as a surprise to stable users. 19:57:24 anyway, i have some points 19:57:51 branch per Debian release with updates going on top of it? 19:58:17 We should have a "stable" branch that only gets targeted changes. 19:58:34 While master is "unstable", and can get breaking changes 19:58:35 no, it should never be called "stable" 19:59:27 first of my topics is: mirror names 19:59:31 #topic mirror names 20:00:03 noone took up that task to define names for mirrors? 20:00:35 waldi, noahm DEP14 for branch names :-) 20:01:53 kuLa: this might be quite good idea 20:02:11 waldi: what names need to be discussed? I'm just not aware I think 20:02:16 waldi: yes, of course it should be literally "stable" 20:02:29 but I do think we want a branch for buster, now that it is stable. 20:02:49 FWIW, the stretch AMIs have been built from a dedicated branch for a long time. 20:03:02 waldi: do we have to be creative with mirror names? why not something like [provider]-mirror[counter].debian.org 20:03:05 Which has helped keep things consistent as master has churned 20:03:22 +1 for using DEP14 nomenclature for branches 20:04:24 kuLa: it needs to be discussed and implemented with DSA, that's the more important point 20:05:05 kuLa: provider.cloud.mirrors.debian.org 20:05:12 I think this is a delegate or delegate of the delegate task :-) 20:05:13 #idea naming of branches in our images' repo 20:05:28 #idea naming of in-cloud mirrors 20:06:51 Any more topics, or are we getting a bit tired? 20:07:06 #topic anything else 20:07:10 BTW - I updated our sprint's wiki page 20:07:11 #info mirror naming convention could be provider.cloud.mirrors.debian.org 20:07:21 yes, i have another one 20:07:39 Please put attendance and workitems proposals there 20:08:15 a random thing: we might want to prepare an agenda somewhere before the meetings 20:08:23 i would like to move the stuff with direct access to infrastructure, daily images, release images, cleanup, into it's own group 20:08:40 You mean in Salsa, or somewhere else? 20:08:48 on salsa 20:09:00 So only limited members of the cloud team can actually publish images? 20:09:50 We already patially discussed it during last spring (when we were talking about user accounts on cloud providers 20:10:20 And during Salsa user cleanup (i.e. demoting some users in our project) 20:10:35 So should we have separate project? 20:10:40 noahm: yes, the same as now. but splitting it into it's own group makes accidents less likely 20:10:46 serpent_: s/project/group/ 20:10:47 e.g. debian-cloud-puslishing? 20:10:58 yeah. It should be harder to publish an image than to make a simple contribution to the debian-cloud-images repo. 20:11:05 So, +1 to that idea. 20:11:12 yea, also agreed 20:11:19 Agreed - just like access to Casulana is also limited 20:11:20 But... Who gets access to the big "go" button? 20:11:23 do we really need it? separation on the CI stages I think is better option to not alienate contributors 20:11:48 I don't think this is alienating anybody. 20:12:04 I actually think it makes it easier to become a contributor, since the bar doesn't need to be quite as high. 20:12:04 I guess this depends on how we configure pipeline and integration 20:12:23 There's no risk that you'll accidentally publish something to all the clouds. 20:12:32 But as we're now discussing our workflows - this is not a bad idea 20:12:46 I'm not opposing the idea just asking TBH 20:13:12 noahm: it is more about accidently freeing the access information stored within the projects 20:13:29 Again - we don't need to decide it right now, but something to think about 20:14:02 Then we'll need to discuss which projects belong to main group and which to internal one 20:14:44 And how to allow for contributions from non-members (e.g. changes in list of isntalled packages, default configuration, etc.) 20:15:09 i only speak about image relates ones: a new images-daily, the existing images-release and images-housekeeping 20:15:26 not even the existing debian-cloud-images would be affected 20:15:48 And maybe mirrors' infrastructure - but not sure about that 20:16:04 yeah, when we start to use it 20:16:52 #idea Separate Salsa group for clould image publishing and mirrors, with more restricted membership 20:17:11 #info https://wiki.debian.org/Sprints/2019/DebianCloud2019 20:17:41 okay. anyone got something else? 20:17:45 not me. 20:18:01 We still haven't talked about image finder 20:18:13 right 20:18:22 what do you want to talk about? 20:18:54 #topic image finder 20:18:57 while technically being backup mentor, i'm also completely lost and have no real idea about the current state as i'm lacking time 20:19:20 Any idea when we might be able to see a working prototype/preview? 20:19:40 We'll need to integrate it. Arthur is GSoC student working on it, utkarsh2102 is helping with making proper Debian package from it 20:19:53 Is it deployed anywhere? 20:20:19 During BoF we had discussion that Thomas will provide VM to run it (at least in the beginning) 20:20:22 not yet 20:20:23 arthurbdiniz presented his working at debconf, and after that he has been implementing a a feature where people will need a token to post new data 20:20:25 What's the status of it? 20:20:26 not sure what we need packages for. if we are going to deploy it anywhere usable it's not going to use packages 20:21:20 I will review this new feature this week and we are planning to deploy it somewhere, zigo offered a VM for us to do this 20:21:37 But still we'll need for some people to be familiar with that code if we're supposed to deploy it under team care 20:21:51 o/ 20:21:54 package in nice to have, running it is not a issue either we can run it from AWS account for example 20:21:57 Please ping me next time ... 20:22:31 yeah, I would think that the AWS infra account (or any other cloud provider) should give us plenty of resources for a proper deployment (ideally on more than just a single VM) 20:22:49 ...Assuming we ever get the AWS infra account in order. 20:23:00 TBH I'd like to see how it's running and automate deployment, etc 20:23:07 noahm: lol :-) 20:23:43 after that we want to see the best way to populate the image finder, if we want the image finder to parse the metadata file generated by salsa ci scripts or if we want the salsa ci scripts posting data to the image finder when new images are published 20:24:10 kuLa, we have a docker image that you can run it for now 20:24:29 And API so we can integrate it better - and possibly push images to OpenStack providers 20:25:06 kanashiro: ack, I'll try to have a look at this later this week 20:26:15 kuLa, the image is available in the registry we have enabled in the image-finder repo 20:26:31 We definitively need an API there, yes. 20:26:43 https://salsa.debian.org/cloud-team/image-finder/container_registry 20:26:49 I'm not sure if we should rely on 3rd party systems like salsa for populating its db 20:27:42 kanashiro: is that something like docker registry? 20:27:57 utkarsh2102[m], yep 20:28:05 we can integrate with one stage on the debian cloud image CI calling the API 20:28:06 arthurbdiniz: Should we use the master branch now, for the image finder? 20:28:09 Coolio. 20:28:28 the master branch is the stable content 20:28:39 but the app there still not ready 20:28:56 arthurbdiniz: Let me ask a better way: against what branch should I send pull requests? 20:29:10 development 20:29:13 Ok. 20:29:14 there are some pending MRs that I need to review 20:29:36 9 MRs to review 20:30:17 @zigo i create a branch for you https://salsa.debian.org/cloud-team/image-finder/merge_requests/34 to work on PBR 20:30:20 zigo, arthurbdiniz has documented the project's branch policy here: https://salsa.debian.org/cloud-team/image-finder/wikis/Branch-Policy 20:30:45 wow a big one registry.salsa.debian.org/cloud-team/image-finder latest a5855a6b66ee 2 weeks ago 524MB 20:30:50 arthurbdiniz: I'll redo it. 20:31:36 IMO, this branch stuff is a bit overkill, especially for something not yet in production... :P 20:31:57 kuLa, there is room for many improvements :) 20:33:36 So, any actions here? 20:33:45 kanashiro: :-) ack 20:34:02 I hope arthurbdiniz will keep working on image finder after gsoc :) 20:34:15 kanashiro sure i will 20:34:21 serpent_: I'd say we need to figure out where are we going to host it 20:35:02 and if cloud team is going to maintain it or DSA if the latter we need to work with them on infra 20:35:05 kuLa: we want .debian.org, at least in the long term 20:35:12 AFAIR for now Infomaniak (zigo) will provide VM. Then, after we have some experience, we can move it somewhere 20:35:32 I am also panning to request a .debian.net domain for the image finder 20:35:46 waldi: agreed, but first we should have something running - and here debian.net sounds good 20:36:09 +1 to that 20:36:21 The debian.net subdomain is easy to do. 20:36:28 The VM @infomaniak too ... 20:36:33 We should try to get it up and running asap so we can poke at the UI, etc, and give feedback 20:36:42 debian.org are usually under DSA and this will take time and I'm not sure if we should dump this on them 20:36:53 +1 to running it ASAP 20:36:53 Both done in less than 1 minutes with a command line ... :P 20:36:54 noahm: +1 20:37:23 It'll also be good to be able to work out how it fits into the publication workflow. 20:37:42 Though I want it packaged, together with a puppet or ansible script to set it up. 20:37:43 I have never created a subdomain, so it will be more than 1 min for me :-) 20:37:52 but we will do it asap 20:38:15 Well, 1/ pbr stuff 2/ debian package 3/ puppet thing 4/ hosting. 20:38:22 It *must* be in this order. 20:38:48 * kuLa need to drop off so cu later guys 20:38:57 see you 20:38:58 can't we use the docker image for testing purpose? 20:39:38 I'm sure we can test the initial set of functionality using them. 20:39:51 we don't need a .deb for hosting, either for testing or for production. 20:39:59 Plenty of what DSA runs today is not packaged. 20:40:10 I think you are imposing many constraints with this "must" 20:40:25 noahm: Sure, it can be messy, though we also can do things right! :P 20:40:43 It's not as if all of that was hard to do. 20:40:54 so we have anything left to discuss? 20:41:19 I think we are done 20:41:25 good 20:41:29 #topic Anything else 20:41:36 Should we do this again next month? 20:41:37 again: anyone got something else? 20:41:42 serpent_ and waldi can we talk about debian docker images? 20:41:47 Nothing for now 20:41:52 arthurbdiniz: no, why? 20:41:57 arthurbdiniz: the right people aren't here. 20:42:10 Docker - what do you mean? That we should prepare them? 20:42:25 the cloud team has not historically been involved in the creation of the public docker images. 20:42:39 to find the dd that builds the docker images that we talked on the BoF 20:42:41 Maybe let's add this to sprnt agenda, and (maybe) talk about it during next meeting 20:42:57 we should have this monthly meeting with a defined agenda 20:43:05 Yes. 20:43:08 ack 20:43:18 Any proposals for next month meeting? 20:43:21 #action discuss docker images 20:43:27 #topic Next meeting 20:43:38 arthurbdiniz: Did you write a wsgi entroy point for your app? 20:43:39 lets just use the same date and time 20:43:48 agreed 20:43:56 14th, 1900 UTC? 20:43:57 So second Wednesday of month? 20:44:05 zigo not yet 20:44:11 11th of september 20:44:17 14h of september will be Saturday 20:44:35 11th, 1900 UTC, then. 20:44:43 any objections to 9/11 from USA team members? 20:44:44 We can just settle on the 2nd wednesday of each month, if that's fine for everyone. 20:44:59 ack 20:45:20 and we should have a wiki page (or something else) where people can add topics before the meeting 20:45:34 Mostly fine for me, might be harder at the end of the year, but not sure yet 20:45:54 kanashiro: Gobby is usually the Debian way... :P 20:46:07 #action wiki page with propsed topics of next IRC meeting 20:46:26 zigo, that also works, some other teams use wiki pages 20:46:34 I'm fine with both. 20:46:44 either one is fine. let's just add it to the topic of this channel so it's easy to find. 20:46:49 OK, let's wrap this up 20:46:59 #agreed next meeting will be 2019-09-11T19:00Z 20:47:15 I'll summarize this meeting - but it might take few days 20:47:22 #endmeeting