Archiv der Kategorie: Software

The Apple Keynote Feature we have been waiting for

22.10.2021 admin

Apple updated last month Keynote with a feature we have been waiting for years – live video which is super cool to show live internet pages from active polls.

insert video only works from the top menu

There is no video source connected at the beginning but can can be added from the right side menu.

Unfortunately the virtual camera of OBS is not recognized but I could easily connect my Blackmagic Atem Mini so I have direct access to any source coming from a second computer running Chrome, Ipad with Sketchbook and of course the Z6 HDMI video signal.

adding the ATEM Mini from the right menu

Software

A comparison of image duplication software

12.09.2021 admin

A quick comparison without pretending any objectivity

	Open Source	Commercial / Restricted Access	Web	Upper Limit Images	Speed	Sensitivity	Specificity	Comment
Image Verification Assistant	N	N	Y	1	*	*	*
Forensically	N	N	Y	1	***	*	*
FotoForensics	N	N	Y	1	**	*	*
Diplopia	N	N	Y	>1000	***	*	*	my own
ImageTwin	N	Y	Y	10	***	**	**
Lpixel	N	Y	Y	50?	?	?	?
Proofig	N	Y	Y	50?	*	**	**
Droplets	Y	N	N	1	*	*	*
ImageJ	Y	N	N	1	?	?	?
Sherloq	Y	N	N	1	***	**	**	good toolbox
TinEye	N	Y	Y	∞	***	**	**	full images only

max rating is ***

Allergy, Software

Geschützt: When a scientific journal is modifying your images

28.08.2021 admin

Philosophy, Software

Scientific PDFs

12.07.2021 admin

I found only one relevant blog post about PDFs produced by scientific publishers.

Although PDFs are the main formal output nowadays (no more “papers”) there is basically no standardization which meta data should be included in scientifc PDFs. It’s largely due to the software in the production office what’s in the PDF document — a largely underused resource.

This is at least my experience when working on an image duplication pipeline in scientific papers. But test it yourself ….

Philosophy, Software

Steve Jobs’ 2005 Stanford Commencement Address

9.06.2021 admin

Software

Finally I understand JS (a bit)

3.06.2021 admin

It produced a lot of headaches. And yes, it has been described already that

as a lot of articles I read about async in JavaScript, especially those that came out around the time ES2015 (ES6) was new, are just plain wrong. I’m going to clear up the falsehood by presenting a real understanding of the way async works in JavaScript.

Some nice examples are at medium.com and freecodecamp as well as a vid at youtube
.

At the end – I have some working code here, that shouldn’t work according to my understanding of concurrency.

Software

How to monitor any website. At any time interval. With Telegram notification. For Free.

16.04.2021 admin

These instructions work for OSX Catalina only and are a bit different than the Linux version shown at urlwatch.

python3 -m pip install pyyaml minidb requests keyring appdirs lxml cssselect html2text
python3 -m pip install urlwatch
EDITOR=nano
urlwatch --edit
# CTRL+X leave the editor without saving

Then edit ~/Library/Application Support/urlwatch/urls.yaml

kind: url
max_tries: 3
name: Camptoi
url: https://www.camptoi.de
filter:
- element-by-id: product-desc-18713727425
- html2text:
    body_width: 0
    ignore_images: false
    ignore_links: false
    inline_links: false
    method: pyhtml2text
    pad_tables: false
    single_line_break: true
    unicode_snob: true

After that we create the Telegram bot by sending

/newbot

to user BotFather and record the <API> from the response.

We also need to send a dummy message to the new bot so we can look up the sender <ID>

https://api.telegram.org/bot<API>/getUpdates

<API> and <ID> are both entered into ~/Library/Application Support/urlwatch/urlwatch.yaml

...
  telegram:
    bot_token: '<API>'
    chat_id: '<ID>'
    enabled: true
---

As we have no cron under MacOS we need a parameter file to run launchd. Should be placed at ~/Library/LaunchAgents/com.urlwatch.plist

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
	<dict>
		<key>Label</key>
		<string>com.urlwatch</string>
		<key>Program</key>
		<string>/Users/wjst/opt/anaconda3/bin/urlwatch</string>
		<key>RunAtLoad</key>
        <true/>
        <key>StartInterval</key>
        <integer>9000</integer>
        <key>KeepAlive</key>
         <true/>       
	</dict>
</plist>

Ultimately, the agent is started (or stopped) using

launchctl load -w  ~/Library/LaunchAgents/com.urlwatch.plist               
launchctl unload ~/Library/LaunchAgents/com.urlwatch.plist

Software

How to scrape a website with R II: WYSIWYG

9.02.2021 admin

Part II

Although Rselenium allows a screenshot of the current browser window

library(RSelenium)
remDr <- remoteDriver(
  remoteServerAddr = "localhost",
  port = 4444,
  browserName = "Chrome"
)
remDr$open()
remDr$navigate("http://google.com")
remDr$screenshot(display = T) # remDr$screenshot(file="screen.jpg")

I found it extremely difficult to control a webbrowser running in a Docker container – looking up the DOM tree, injecting javascript etc is a lot of guess work.

So we need also a VNC server in the docker container as found at github.

After starting in the terminal

docker run -d -p 4444:4444 -p 5900:5900 -v /dev/shm:/dev/shm selenium/standalone-chrome:4.0.0-beta-1-prerelease-20210207

we can watch live at vnc://127.0.0.1:5900 what’s going on.

Software

Sometimes it is better to switch bikes not gears

28.01.2021 admin

My 3 favorite programs? R, Bookends and Exposure.

The first choice is Rstudio (since 2012, being a long time SAS user). Here is the most recent JJ Allaire keynote

I was a bit with late with Bookends in 2018 (being a long time Sente user) but here is an introduction by Jon Ashwell.

And I am currently migrating to Exposure (after having used Lightroom for 13 years) by Jeff Butterworth

Life changes every day while it is sometimes better to switch bikes not gears.

Software

Breaking up long chains in R’s margrittr code and calling sub functions

26.01.2021 admin

Having several long and redundant chains in R ‘s margittr code, I have now figured out how to pipe into named and unnamed functions

f1 <- function(x) {
  x %>% count() %>% print()
}
f2 <- function(x) {
  x %>% tibble() %>% print()
}

So we have now two named functions with code blocks that can be inserted in an unnamed function whenever needed

iris %>%
  # do any select, mutate ....
  # before running both functions
  (function(x) {
    x %>% select(Species) %>% f1() %>% print()
    x %>% f2() %>% print()
  })

Software

How to save a Twitter thread

5.01.2021 admin

This is not a trivial task as most browser produce garbage when printing to pdf. Also screenshots do not help so much with multipage threads. “Unroll” also doesn’t work reliable.

So I have been using the archive.today plugin before producing the pdf, but this method is time consuming as it needs a captcha.

Having now Selenium running in a docker container, there is a more convenient solution where just two lines of R are sufficient

remDr$navigate("https://twitter.com/SZ_Muenchen/status/1346425350394236930")
remDr$screenshot(file = 'screen.png')

username <- remDr$findElement(using = "name", value = "session[username_or_email]")
username$sendKeysToElement(list("XXX"))
passwd <- remDr$findElement(using = "name", value = "session[password]")
passwd$sendKeysToElement(list("XXX", "\uE007"))

Software

RKI Daten sind tages- und nicht fallbasiert

26.11.2020 admin

Leider kann man mit den RKI Daten nicht direkt in ein Regressionsmodell gehen, weil an vielen Tagen mehr als ein Fall in derselben Kategorie auftritt RKI Daten sind tages- und nicht fallbasiert weiterlesen →

Software

How to scrape a website with R I: Using a browser generated cookie

19.11.2020 admin

While there are quite some SO examples out there how to manage the login, here are the ncessary steps whenever you need to login in manually and have to start with a browser cookie. First install the “EditThisCookie” plugin in Chrome and export the cookie How to scrape a website with R I: Using a browser generated cookie weiterlesen →

Software

Better than a streamdeck: the Mac touchbar

1.11.2020 admin

I have been thinking to buy an Elgato Streamdeck as we have to lecture now also online during winter 2020.

While the Streamdeck mini would be a nice addition to the Elgato 4 K Camlink (that connects the Nikon) as well as the Epoc Cam software (that connects the Iphone) for easy switching input channels, I ultimately decided against this solution and just reconfigured the Touchbar for OBS using Better Touch Tool.