Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for RETS to import MLS data #2

Open
etewiah opened this issue Jan 1, 2017 · 22 comments
Open

Support for RETS to import MLS data #2

etewiah opened this issue Jan 1, 2017 · 22 comments

Comments

@etewiah
Copy link
Owner

etewiah commented Jan 1, 2017

The number 1 feature request I have received since launching PropertyWebBuilder has been to add support for importing MLS data.
This is on my TODO list and I'm looking at various options such as:

The third option is likely to be the most difficult and time consuming but it is also the one that most appeals to me. Huginn is an amazing tool and using it would open up the possibility to accommodate new endpoints for importing data more easily. I will investigate it some more over the coming days and update this issue on the progress I make.

If this feature is of interest to you (either as a developer or a realtor) feel free to comment on this issue.
@jwoertink
Copy link

This project looks pretty cool! I wrote a gem a while back https://github.com/jwoertink/tourets that could be good for it. I don't work in this field anymore, so I haven't had the chance to really work on it. If you're interested in it, I can make you a maintainer on it, and help out where I can.

@etewiah
Copy link
Owner Author

etewiah commented Jan 11, 2017

@jwoertink thanks for reaching out - great to hear from you!

Just had a look at tourets - it looks ideal for my use case. Right now I'm still busy fixing some bugs, adding tests etc. I hope to be able to start work on RETS integration in the next couple of weeks or so. At that point I will give tourets a spin and see if it works out for me.

The only thing I see right now that might be an issue is that its built on the placester RETS gem which is not being maintained anymore. If its fairly easy to swap that out for the estately rets gem (https://github.com/estately/rets) then I'll try to do that.

Yes, please make me a maintainer and I'll try to contribute.

One more thing - did you happen to find some RETS servers against which I could try things out with test credentials?

@jwoertink
Copy link

My master branch is way out of date, but I have a rails branch that already has the placester gem ripped out. As far as I know, you have to pay to have access to the MLS and RETS. The idea behind TouRETS though was for an easy rails integration while being able to support multiple RETS server.

I'll add you on there, and we can work on making it more solid. Maybe @russ would like to get in on this action?

@etewiah
Copy link
Owner Author

etewiah commented Jan 11, 2017

Thanks @jwoertink - got your invite. I'll look into it as soon as I get the chance.

@etewiah
Copy link
Owner Author

etewiah commented Feb 7, 2017

Just found out today about an initiative to make it easier to access MLS data for development purposes. Applying for access now. Hope it makes things easier.

http://www.inman.com/2017/01/26/free-mls-data-feed-could-speed-up-real-estate-innovation/amp/

@mcohen9
Copy link

mcohen9 commented Apr 24, 2017

Just saw the updates for importing data from the MLS. looking pretty good so far this is exactly what im looking for. A suggestion would be to add support for OLR imports since its the main DB used for the NYC real estate market.

@etewiah
Copy link
Owner Author

etewiah commented Apr 24, 2017

Hi @mcohen9 , that was fast - I haven't even got round to writing about it here ;)

I have just had a look at the OLR website and they don't give me a chance to create a test account. Can you provide me a test account that I can use for development purposes? It can be just a temporary one that is deleted after a few days.

@mcohen9
Copy link

mcohen9 commented Apr 24, 2017 •
edited
Loading

Thanks man! @etewiah yes whats your email?

@etewiah
Copy link
Owner Author

etewiah commented Apr 24, 2017

No worries @mcohen9. Just send me an email (ed at propertywebbuilder.com) and let's figure out a way to make it work.

@PaulyStix
Copy link

Hi,

I am currently in Albany,NY using https://crmls.paragonrels.com/ParagonLS/Default.mvc. Any help getting this added would be great!

@etewiah
Copy link
Owner Author

etewiah commented May 12, 2017

Hi @PaulyStix , I will have a look sometime next week. Do you have test credentials or a test server somewhere I can use for developing with?

@PaulyStix
Copy link

PaulyStix commented May 12, 2017 via email

@etewiah
Copy link
Owner Author

etewiah commented May 12, 2017

Hi @PaulyStix, heroku does indeed allow you to add custom domains for free. The instructions are here:

https://devcenter.heroku.com/articles/custom-domains

If that is too confusing, give me a shout and I'll talk you through it.
(BTW - for each question, it is better to open a different issue. This will make it easier for people who have the same question in future to find the answer)

For the MLS, you already gave me the url but as I don't have credentials (username / password) to access it I cannot test to see exactly how the data is returned. Often an MLS will let you create test credential which you can share with a dev. Send me an email (ed at propertywebbuilder.com ) and we can discuss further.

@PaulyStix
Copy link

PaulyStix commented May 18, 2017 via email

@etewiah
Copy link
Owner Author

etewiah commented May 18, 2017

Hi Paul, sharing a screen won't help much I'm afraid. When I get the chance I'll approach the MLS myself to ask if they can provide some test/dev data I can work with.

Did you have any luck with the custom domain on heroku?

@PaulyStix
Copy link

PaulyStix commented May 18, 2017 via email

@etewiah
Copy link
Owner Author

etewiah commented May 18, 2017

Hi Paul, let's continue this conversation by email - everyone subscribed to this issue will get notifications about each comment here which can get annoying for them.
I can't see your attachment so please email it to me ( ed at propertywebbuilder.com ) and I'll try to help.

@Jscott388
Copy link

Where you guys at with this? I have access to RETS data. I have 520 fields that I have to deal with. They aren't clearly. Some just say LM_Char10_7 as the field, some have better names, but over all the field labeling is ugly. So once you get this data, I am like how do I want to save this, in my case I am using mongodb. From there I have to figure out how to keep this updated. This is no easy task.

@etewiah
Copy link
Owner Author

etewiah commented Jun 22, 2017

Hey @Jscott388, I haven't had the chance to work on this in the last month. I hope to be able to return to it in a couple of weeks though. I am also thinking of making a standalone project out of this functionality. That would make it easier for people to export to their own data stores like mongodb.

Yes, one of the tricky bits to this is getting all the field mappings right. Do you have any Ruby on Rails experience? If you want me to explain a bit about how I went about this, feel free to give me a shout on skype (my user id is tewiii ) and we can schedule a chat.

@Jscott388
Copy link

I figured it out. Use a mongoose schema and set the alias as the system name from the Rets data.

@christmoore
Copy link

What's the current status for this issue?

@etewiah
Copy link
Owner Author

etewiah commented Jul 5, 2022

Right now my focus is on migrating to vue js with the quasar framework:

#131

Happy to return to this issue if someone wants to work with me on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@jwoertink @etewiah @mcohen9 @christmoore @Jscott388 @PaulyStix