marklogic - SPARQL queries causing XDMP-MEMCANCELED -

-

we performing series of different sparql queries on database containing ~5 million triples.

our queries cause xdmp-memcanceled-error though not consistently, return correct result within few seconds or less. queries occationally seems hang , cause server run @ 100% cpu until query times out.

we have tried increasing memory-related settings find. query runs fine on other triple stores/engines.

we running marklogic 8.0-11 aws instance 8 gb of internal memory , 16 gb of swap space.

example of straightforward query causes error:

prefix xsd: <http://www.w3.org/2001/xmlschema#> prefix t5_m: <http://url.com/t5/model#> prefix t5_d: <http://url.com/t5/data#> select distinct ?_app_id ( ?_err ?_reason ) ?_comment ?_severity { bind ( 3 ?_severity) bind ( "generated hl7 v2 conformance profile of ihe pcd-01 message" ?_comment )  filter( ?_app_id = 'app_id') filter ( ?_ts  >= '2015-04-21t09:04:07.871' ) filter ( ?_ts  <= '2015-04-21t09:07:43.973' )  ?ack t5_m:hasmsh ?msh . ?msh t5_m:hasmsh.5 ?msh_5 . ?msh_5 t5_m:hashd.1 ?hd_1 . ?hd_1 t5_m:hd.1value ?_app_id .  ?ack t5_m:hasmsa ?msa . ?msa t5_m:hasmsa.2 ?msa_2 . ?msa_2 t5_m:msa.2value ?_msg_id .  ?pcd_01_message t5_m:pcd_01_message . ?pcd_01_message t5_m:id ?_msg_id . ?pcd_01_message t5_m:timestamp ?_ts .  ?ack t5_m:haserr ?err . ?err t5_m:haserr.7 ?err_7 . ?err_7 t5_m:err.7value ?_err . }

is there relevant configuration settings have missed or there wrong query?

yours truly, alexander

when total hash join table size of running sparql queries exceeds 50% of host memory, sparql query using memory hash joins canceled "xdmp-memcanceled" error. may indicate number of things:

  1. the host overloaded number of simultaneously executing sparql queries. try adding more memory host (8gb small) or load-balancing sparql queries across more marklogic hosts.

  2. the sparql query optimizer picking poor query plans query. sparql queries larger numbers of joins (for instance query has 13 joins), try execute sem:sparql() function higher optimization level, ie: try adding option "optimize=2".

  3. the query optimizer may have bug or deficiency causes choice of poor query plan. should contact marklogic support - able guide find out query plan chosen , optimization parameters lead problem. may able suggest solution given more information, or may file bug report fix made.

john


Comments

Post a Comment

Popular posts from this blog

java - Custom OutputStreamAppender not run: LOGBACK: No context given for <MYAPPENDER> -

-
i wish write custom appender on basis of outputstreamappender . wrote following class package tests; import java.io.ioexception; import java.io.outputstream; import ch.qos.logback.core.outputstreamappender; public class myappender<e> extends outputstreamappender<e> { public myappender() { system.out.println("myappender created"); setoutputstream(new outputstream() { @override public void write(int b) throws ioexception { throw new unsupportedoperationexception(); } }); } } then wrote following runner: package tests; import org.slf4j.loggerfactory; import ch.qos.logback.classic.logger; public class runner { private static final logger log = (logger) loggerfactory.getlogger(runner.class); public static void main(string[] args) { //log.addappender(new myappender<iloggingevent>()); log.info("hello world"); } } finall...
Read more

java - UML - How would you draw a try catch in a sequence diagram? -

-
Image
is there standard way of drawing try catch sequence diagrams? i've made attempt based on this feel end result doesn't feel right. code diagram based around: public static void save () { try { filehandle filehandle = gdx.files.external(file); filehandle.writestring(boolean.tostring(constantshandler.soundenabled)+"\n", false); (int = 0; < 5; i++) { filehandle.writestring(integer.tostring(constantshandler.highscores[i])+"\n", true); } } catch (throwable e) { } } my attempt note: know still need add loop. that's ok. fragments meant show conditional control flow in sequence diagram. superstructures puts limitations on use of fragments (see pp. 467 of ss2.1.1). should use critical region try part above. , option catch . however, keep telling can take quite freedom in using uml. it's language , such changes in life time. long reader ge...
Read more

c++ - No viable overloaded operator for references a map -

-
i trying use map can make tag names reference number. when try , use it, in code error (6 in total every time reference map): src/main.cpp:25:45: error: no viable overloaded operator[] type 'std::map<std::string, std::string>' const char* idcs = node.child_value(tagmap[3]); this code: #include "pugi/pugixml.hpp" #include <iostream> #include <string> #include <map> int main() { pugi::xml_document doca, docb; std::map<std::string, pugi::xml_node> mapa, mapb; std::map<std::string, std::string> tagmap {{"1", "data"}, {"2", "entry"}, {"3", "id"}, {"4", "content"}}; if (!doca.load_file("a.xml") || !docb.load_file("b.xml")) { std::cout << "can't find input files"; return 1; } (auto& node: doca.child(tagmap[1]).children(tagmap[2])) { co...
Read more