css - Memory usage explodes when using CSSApply within function -


i observed weird behavior when using command cssapply library css inside function.

basically, each time call function, r uses additional 0.5mb of memory. since want use function extract data 20.000 webpages, r crashes because has memory problems.

here sample code reproduces problem:

library(css)  f <- function() {  url <- "http://www.kickstarter.com/projects/2049768676/schoolhaus-a4" page.o <- readlines(url) page <- htmlparse(page.o) name <- cssapply(page, "#name", csscharacter) return(name) }  x <- character(200)  (i in 1:length(x)) { x[i] <- f()   print(i) flush.console() }

first thought using data.frame problem, figured out cssapply problem. if comment out, memory usage stays more or less constant.

if has idea what's problem, appreciate help.

thanks much,

dainis


Comments

Post a Comment

Popular posts from this blog

rdbms - what exactly the undo information lives in oracle? -

some docs says, there "undo tablespaces" implies should create tablespace undo imformation. some docs says, there "undo segment" implies undo information lives in normal tablespaces , use of it's segment. so, undo information lives , organized? earlier releases of oracle database used rollback segments store undo. oracle9i introduced automatic undo management, simplifies undo space management eliminating complexities associated rollback segment management. oracle recommends (oracle 9i , on words) use undo tablespace (automatic undo management) manage undo rather rollback segments. when creating undo tablespace, these automatically created: n undo segments (based on sessions parameter value) named _syssmun$ owned public (usable ops configuration) not manually manageable
Read more

bash - How do you programmatically add a bats test? -

i'd have bats test created every file in directory, i'm not sure best way done is. approach below creates single test when there many files in directory. #!/usr/bin/env bats in $(ls) @test "testing $i" { pwd } done to extract ls output not batter solution go wrong on filenames spaces. you can below shopt -s nullglob file in /dir/* //test command on $file done shopt -u nullglob you can using find command also find /some/directory -maxdepth 1 -type f -exec cmd option {} \;
Read more

java - Getting exception in JDBC thin driver -

i try run query using java , below mentioned program import java.sql.connection; import java.sql.drivermanager; import java.sql.resultset; import java.sql.statement; import javax.naming.spi.dirstatefactory.result; public class oracleconn { public static void main(string[] args) { try { class.forname("oracle.jdbc.driver.oracledriver"); connection con = drivermanager.getconnection("jdbc:oracle:thin:@localhost:1521:yglobal","user","user"); statement stmt = con.createstatement(); resultset rs = stmt.executequery("select empid empmaster"); while(rs.next()) system.out.println(rs.getint(1)); con.close(); } catch (exception e) { e.printstacktrace(); }} } but when tried run program getting exception java.sql.sqlexception: ora-01756: quoted string not terminated @ oracle.jdbc.driver.databasee...
Read more