What packages are desired for the virtual machine PXE Boot image?

[mbainrot]

Hey all,

I've been working on setting up the virtual machine image (debian preseed automated install) and so far I got the following setup on the python image.

• python 2.7.7 (built from source)
• pip (via get-pip.py)
• ipython & ipython notebook
• flask
• vmware tools (vbox tools is a bit of a pig, more work needed on that front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of things. This means that basically the system reboots into linux and autologins in as root. It propmpts for desktop theme but so far it seems like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only going to provide the community version.

Ta,
Max

[B0073D]

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up
remotes in PyCharm (including ssh and file access etc) so I think this
might be overkill. Additionally some people use the paid version.

To clarify, you can run your IDE (pycharm) and have it connect to your dev environment (the vm).

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot [email protected] wrote:

Hey all,

I've been working on setting up the virtual machine image (debian preseed
automated install) and so far I got the following setup on the python image.

• python 2.7.7 (built from source)
• pip (via get-pip.py)
• ipython & ipython notebook
• flask
• vmware tools (vbox tools is a bit of a pig, more work needed on that
  front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of
things. This means that basically the system reboots into linux and
autologins in as root. It propmpts for desktop theme but so far it seems
like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only
going to provide the community version.

Ta,
Max

—
Reply to this email directly or view it on GitHub
#2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

[jamiereid]

I think it would be best to use Python3 if we are going to use python. Are
you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D [email protected] wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set up
remotes in PyCharm (including ssh and file access etc) so I think this
might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot [email protected]
wrote:

Hey all,

I've been working on setting up the virtual machine image (debian
preseed
automated install) and so far I got the following setup on the python
image.

• python 2.7.7 (built from source)
• pip (via get-pip.py)
• ipython & ipython notebook
• flask
• vmware tools (vbox tools is a bit of a pig, more work needed on that
  front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of
things. This means that basically the system reboots into linux and
autologins in as root. It propmpts for desktop theme but so far it seems
like it doesn't care if it's ignored, it just asks again on next login.

Jamie has suggested PyCharm, looking into how to install it now. Only
going to provide the community version.

Ta,
Max

—
Reply to this email directly or view it on GitHub
#2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[mbainrot]

@B0073D okies, I will leave the tar.gz in the http://192.168.0.1/res directory for those who want it (as not to contribute to the congestion on the tiny little internet connection at the facility)

Its actually really easy to setup (side effect of it's somewhat closed source nature maybe?) so should be OK.

[B0073D]

is flask and flask-peewee etc etc etc compatible with 3?

I'd maybe stick with 2.7 as there are more modules/tools are available.
On 17/06/2014 11:09 AM, "Jamie Reid" [email protected] wrote:

I think it would be best to use Python3 if we are going to use python. Are
you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D [email protected]
wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily set
up
remotes in PyCharm (including ssh and file access etc) so I think this
might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot [email protected]
wrote:

Hey all,

I've been working on setting up the virtual machine image (debian
preseed
automated install) and so far I got the following setup on the python
image.

• python 2.7.7 (built from source)
• pip (via get-pip.py)
• ipython & ipython notebook
• flask
• vmware tools (vbox tools is a bit of a pig, more work needed on that
  front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage of
things. This means that basically the system reboots into linux and
autologins in as root. It propmpts for desktop theme but so far it
seems
like it doesn't care if it's ignored, it just asks again on next
login.

Jamie has suggested PyCharm, looking into how to install it now. Only
going to provide the community version.

Ta,
Max

—
Reply to this email directly or view it on GitHub
#2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

—
Reply to this email directly or view it on GitHub
<
https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256770>

.

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[mbainrot]

@jamiereid I thought we chose python 2.7 due to sockets/http? stuff still not marked as mature in python 3.0?

Alternatively is it possible to use both? or do they not get along/cause headaches? (pardon the lack of experience here, I am a .NET code monkey )

[jamiereid]

Yes. mhvdb2 is running on Python3

On Tue, Jun 17, 2014 at 11:12 AM, B0073D [email protected] wrote:

is flask and flask-peewee etc etc etc compatible with 3?

I'd maybe stick with 2.7 as there are more modules/tools are available.
On 17/06/2014 11:09 AM, "Jamie Reid" [email protected] wrote:

I think it would be best to use Python3 if we are going to use python.
Are
you able to include it?

On Tue, Jun 17, 2014 at 11:05 AM, B0073D [email protected]
wrote:

@mbainrot

I think it might be fine to leave pycharm off there. You can easily
set
up
remotes in PyCharm (including ssh and file access etc) so I think this
might be overkill. Additionally some people use the paid version.

On Tue, Jun 17, 2014 at 10:58 AM, mbainrot [email protected]
wrote:

Hey all,

I've been working on setting up the virtual machine image (debian
preseed
automated install) and so far I got the following setup on the
python
image.

• python 2.7.7 (built from source)
• pip (via get-pip.py)
• ipython & ipython notebook
• flask
• vmware tools (vbox tools is a bit of a pig, more work needed on
  that
  front, it does auto install, just doesn't play nice in xfce)

Python stuff and most other stuff is done in a "post install" stage
of
things. This means that basically the system reboots into linux and
autologins in as root. It propmpts for desktop theme but so far it
seems
like it doesn't care if it's ignored, it just asks again on next
login.

Jamie has suggested PyCharm, looking into how to install it now.
Only
going to provide the community version.

Ta,
Max

—
Reply to this email directly or view it on GitHub
#2.

Sincerely,

Tim Suess

Alternative Thought

www.B0073D.com

—
Reply to this email directly or view it on GitHub
<

https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256770>

.

—
Reply to this email directly or view it on GitHub
<
https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46256967>

.

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[jamiereid]

Ah, maybe I missed that part of the discussion the other night. @brendam
do you remember if there was a reason for sticking with python2 as
@mbainrot suggests?

On Tue, Jun 17, 2014 at 11:13 AM, mbainrot [email protected] wrote:

@jamiereid https://github.com/jamiereid I thought we chose python 2.7
due to sockets/http? stuff still not marked as mature in python 3.0?

Alternatively is it possible to use both? or do they not get along/cause
headaches? (pardon the lack of experience here, I am a .NET code monkey )

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[brendam]

We did loose time last year to people having trouble getting a dev
environment setup, so a VM is one way to fix that. But we can also help
people get their dev environment setup ahead of time on their preferred OS
this time. Still helpful to have a VM for people who don't want to do that.

But the other thing I'd like us to protect ourselves from is not having
internet access, or slow internet, at the venue (just in case) - have a
server we can collaborate on if the internet goes down. Possible things for
it to do:

• Copy of the github repository(s) that we can have as an alternate
  'upstream' if github isn't accessible (Maybe with web interface?)
• local integration testing (maybe even an instance of Travis to keep it
  the same)
• Copies of data we think we want to use if possible (might be too large?)
• 'production' environment for demoing product
• install files for things like pycharm etc we might want...
• proxy for pypi so if we grab a package we have a local copy cached for
  everyone else? - or at least a mirror on the local CI if we set one up

However, it is likely to be a fallback option so don't want to overdo what
we have on it - what is the minimum that would be useful

On 17 June 2014 11:09, mbainrot [email protected] wrote:

@B0073D https://github.com/B0073D okies, I will leave the tar.gz in the
http://192.168.0.1/res directory for those who want it (as not to
contribute to the congestion on the tiny little internet connection at the
facility)

Its actually really easy to setup (side effect of it's somewhat closed
source nature maybe?) so should be OK.

Great idea to have install files for things in case the internet is slow.

regards,

Brenda

[mbainrot]

On the editor discussion, http://sourceforge.net/projects/bluefish/files/ what are peoples thoughts? its more of an "incluision", best of all its in the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment and I can work around the OS problems on my big notebook (looses network connectivity randomly)

Though if people have a working environment then i don't care :P provided I don't have to chase my tail because of "compiles on my computer, so must be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people setup their environments.

As for dealing with slow internet, we could always do a download wish list for large data sets and get someone with a silly fast internet connection to download and burn/copy to usb. Alternatively we could try and setup a wifi link back to the maker space.

edit:
@brendam will look at implementing some caching for pip, apt and pypi (pip?) so when one adds a dependancy then we only have to slow download grind once

[rx-gy]

Is there still an intention to meet up this week? A USB drive with
everything hooked up to a raspi as a server / WiFi dump may be a good
option...
On 17/06/2014 12:16 pm, "mbainrot" [email protected] wrote:

On the editor discussion, http://sourceforge.net/projects/bluefish/files/
what are peoples thoughts? its more of an "incluision", best of all its in
the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment
and I can work around the OS problems on my big notebook (looses network
connectivity randomly)

Though if people have a working environment then i don't care :P provided
I don't have to chase my tail because of "compiles on my computer, so must
be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people
setup their environments.

As for dealing with slow internet, we could always do a download wish list
for large data sets and get someone with a silly fast internet connection
to download and burn/copy to usb. Alternatively we could try and setup a
wifi link back to the maker space.

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[kaleyh]

I'll look into setting up a local ci system (similar to Travis).
On 17 Jun 2014 13:29, "Geoff" [email protected] wrote:

Is there still an intention to meet up this week? A USB drive with
everything hooked up to a raspi as a server / WiFi dump may be a good
option...
On 17/06/2014 12:16 pm, "mbainrot" [email protected] wrote:

On the editor discussion,
http://sourceforge.net/projects/bluefish/files/
what are peoples thoughts? its more of an "incluision", best of all its
in
the apt-repos so its addition is trivial

My personal preference is to use a VM, means I have a clean environment
and I can work around the OS problems on my big notebook (looses network
connectivity randomly)

Though if people have a working environment then i don't care :P
provided
I don't have to chase my tail because of "compiles on my computer, so
must
be your environment" syndrome :)

Happy to provide my seed and post install scripts if it'll help people
setup their environments.

As for dealing with slow internet, we could always do a download wish
list
for large data sets and get someone with a silly fast internet
connection
to download and burn/copy to usb. Alternatively we could try and setup a
wifi link back to the maker space.

—
Reply to this email directly or view it on GitHub
<
https://github.com/makehackvoid/govhack2014preparation/issues/2#issuecomment-46260491>

.

—
Reply to this email directly or view it on GitHub
#2 (comment)
.

[mbainrot]

On the topic of local ci, I found the Travis repo. So in theory we could setup a local ci for next year. But it is alot of work and I suspect it would need a fair whack of CPU as Travis uses virtual machines and the puppet like mechanism who's name escapes me

If we follow their structure and not combine services it's about 5-8 VMS with a fair bit of beef on 'em

[kaleyh]

VMs, with the advent of virtual extensions in CPUs, aren't that
expensive. However, travis is waaay over the top for what you need.
Simply use docker, and fire off a container everytime someone pushes to a
git repo on the same server. Git hooks are your friend!

The information can be exposed via a simple HTTP API, just log the docker
output to some files somewhere and have python read them out and summarise
them to whoever wants it.

Would take some time to setup, but it is really flexible and means that you
have an efficient system that doesn't use much in hardware resources.

On Wed, Aug 13, 2014 at 8:16 PM, mbainrot [email protected] wrote:

On the topic of local ci, I found the Travis repo. So in theory we could
setup a local ci for next year. But it is alot of work and I suspect it
would need a fair whack of CPU as Travis uses virtual machines and the
puppet like mechanism who's name escapes me

If we follow their structure and not combine services it's about 5-8 VMS
with a fair bit of beef on 'em

—
Reply to this email directly or view it on GitHub
#2 (comment)
.