Extract Json data from RestFul webservice using Python -

-

we use bugsplatsoftware.com collect crashes. have restfull web service returns json data. data individual crashes. data behind login/password...

i tried following results not expected. 

import requests requests.auth import httpbasicauth  args={'id':11111,'data':0}  response=requests.get("https://www.bugsplatsoftware.com/individualcrash",params=args,auth=httpbasicauth("username","password"))  data=response.json()

response.headers returns following

response.headers {'content-length': '10549', 'connection': 'close', 'server': 'apache/2.4.12 (win32) openssl/1.0.1l php/5.5.21', 'x-frame-options': 'sameorigin', 'x-pingback': 'https://www.bugsplatsoftware.com/xmlrpc.php', 'expires': 'thu, 19 nov 1981 08:52:00 gmt', 'cache-control': 'no-store, no-cache, must-revalidate, post-check=0, pre-check=0', 'x-xss-protection': '1; mode=block', 'date': 'wed, 22 apr 2015 17:43:37 gmt', 'content-encoding': 'gzip', 'link': '<https://www.bugsplatsoftware.com/?p=363>; rel=shortlink', 'vary': 'accept-encoding,user-agent', 'x-content-type-options': 'nosniff', 'x-powered-by': 'php/5.5.21', 'content-type': 'text/html; charset=utf-8', 'pragma': 'no-cache'}

what need json data? in advance.

when print response.url shows https://www.bugsplatsoftware.com/login/ instead of https://www.bugsplatsoftware.com/individualcrash/?id=11111&data=0....

marmeladze, "bugsplatsoftware.com/individualcrash?id=11111&data=0"; returns json data (at least in browser) , need.

pygeek, when call response.content seems data html page.....

ivan, how specify "content-type" requests.get?

seems need using python requests: sessions, cookies, , post tried following 

import requests s=requests.session() data={"login":'tester',"password":'testing'} url="https://wwww.bugsplatsoftware.com/login" r=s.post(url,data=data)

and unauthorized error message

or if

s.get(url) many redirects

this pretty straight forward actually. json close in structure python lists , dictionaries. need convert json string receive web service call appropriate sequence type, can use list comprehension on extract want.

here sample code created call simple web service of mine. 

import urllib, json, collections      def geturlasstring(url):     s = urllib.urlopen(url).read()     return s  def convertjsonstringtosequence(source):     j = json.jsondecoder(object_pairs_hook=collections.ordereddict).decode(source)     return j  def geturlasjsonsequence(url):     s = geturlasstring(url)     return convertjsonstringtosequence(s)  url = "http://127.0.0.1:8081/lookupnames" # local web service s = geturlasstring(url) print s j = geturlasjsonsequence(url) print j  samplejson = [{"lastname": "davinci", "firstname": "leonardo"}, {"lastname": "newton", "firstname": "isaac"}]  filteredlist = [e["firstname"] e in samplejson if e["lastname"].startswith("d")] print filteredlist

much of functions created make easier, main parts this; need import json package. jsondecoder convert string web service call 1 of native python sequences (typically list of dictionaries). wrote bunch of helper functions either convert string sequence, or call url directly , return sequence.

the program wrote give following output:

[{"lastname": "davinci", "firstname": "leonardo"}] [ordereddict([(u'lastname', u'davinci'), (u'firstname', u'leonardo')])] ['leonardo']

Comments

Post a Comment

Popular posts from this blog

java - Custom OutputStreamAppender not run: LOGBACK: No context given for <MYAPPENDER> -

-
i wish write custom appender on basis of outputstreamappender . wrote following class package tests; import java.io.ioexception; import java.io.outputstream; import ch.qos.logback.core.outputstreamappender; public class myappender<e> extends outputstreamappender<e> { public myappender() { system.out.println("myappender created"); setoutputstream(new outputstream() { @override public void write(int b) throws ioexception { throw new unsupportedoperationexception(); } }); } } then wrote following runner: package tests; import org.slf4j.loggerfactory; import ch.qos.logback.classic.logger; public class runner { private static final logger log = (logger) loggerfactory.getlogger(runner.class); public static void main(string[] args) { //log.addappender(new myappender<iloggingevent>()); log.info("hello world"); } } finall...
Read more

java - UML - How would you draw a try catch in a sequence diagram? -

-
Image
is there standard way of drawing try catch sequence diagrams? i've made attempt based on this feel end result doesn't feel right. code diagram based around: public static void save () { try { filehandle filehandle = gdx.files.external(file); filehandle.writestring(boolean.tostring(constantshandler.soundenabled)+"\n", false); (int = 0; < 5; i++) { filehandle.writestring(integer.tostring(constantshandler.highscores[i])+"\n", true); } } catch (throwable e) { } } my attempt note: know still need add loop. that's ok. fragments meant show conditional control flow in sequence diagram. superstructures puts limitations on use of fragments (see pp. 467 of ss2.1.1). should use critical region try part above. , option catch . however, keep telling can take quite freedom in using uml. it's language , such changes in life time. long reader ge...
Read more

c++ - No viable overloaded operator for references a map -

-
i trying use map can make tag names reference number. when try , use it, in code error (6 in total every time reference map): src/main.cpp:25:45: error: no viable overloaded operator[] type 'std::map<std::string, std::string>' const char* idcs = node.child_value(tagmap[3]); this code: #include "pugi/pugixml.hpp" #include <iostream> #include <string> #include <map> int main() { pugi::xml_document doca, docb; std::map<std::string, pugi::xml_node> mapa, mapb; std::map<std::string, std::string> tagmap {{"1", "data"}, {"2", "entry"}, {"3", "id"}, {"4", "content"}}; if (!doca.load_file("a.xml") || !docb.load_file("b.xml")) { std::cout << "can't find input files"; return 1; } (auto& node: doca.child(tagmap[1]).children(tagmap[2])) { co...
Read more