Zotlabs|Hubzilla Development

Mon, 12 Nov 2018 19:28:12 +0000

!Hubzilla Support Forum
!Hubzilla Development

When I create a new Channel and I add a forum to my contact list.
A) the forum needs a manual confirmation (tested with the forums "neu hier" and "deutschsprachige Nutzer")
B) when I surf from the local directory to one of these forum channels the zid is named in the old style "zid=user@hostname" instead of the hash.

could you please check if this behaviour is correct, or is something wrong with my server?

Herbert Thielen

Mon, 12 Nov 2018 22:46:37 +0000

Whether a forum automatically agrees the connect can be configured by the forum owner.

hashtag in cards and articles willn't find from other connected channels

neue medienordnung plus

Mon, 12 Nov 2018 03:32:19 +0000

If I search for hashtags in my own cards and articles, then is the search successful. But if I search for hashtags in cards and articles of other channels, then I find none.
The search for hashtags in posts of other channels is against this successful.
https://framagit.org/hubzilla/core/issues/1300

!Hubzilla Development #hashtagsArticles #hashtagsCards

How to configure SMTP prior to admin registration

Andrew

Sat, 10 Nov 2018 19:59:31 +0000

I would like to enable a custom SMTP account when a hub is installed prior to the admin registration to ensure that the admin gets the verification email. I have had too many problems reliably receiving messages sent from the default sendmail configuration. I know that the PHPMailer addon is available, but I need to enable this from the command line before the admin or even the database has been installed. I don't think this is possible. Hacking around the existing installation workflow is a pain and seems like a bad idea for maintenance.

Does anyone know how to configure the default sendmail to use a custom SMTP server with authentication? This can be a system-wide setting because it is in the context of a Docker container.

show all 6 Comments

Andrew

Sat, 10 Nov 2018 20:05:54 +0000

I see a .htpreconfig.php that might be helpful to disable email verification but leave the rest of the installation flow alone:

    // allow somebody to set some initial settings just in case they can't
    // install without special fiddling

    if(App::$install && file_exists('.htpreconfig.php'))
        @include('.htpreconfig.php');

Andrew

Sat, 10 Nov 2018 21:40:53 +0000

Actually I never noticed this setting that is described in the INSTALL.txt file:

#####################################################################
- If you see an error during database setup that DNS lookup failed
#####################################################################

This is a known issue on some versions of FreeBSD, because 
dns_get_record() fails for some lookups. Create a file in your top webserver 
folder called '.htpreconfig.php' and inside it put the following:

<?php
App::$config['system']['do_not_check_dns'] = 1;

Andrew

Sat, 10 Nov 2018 22:10:52 +0000

That did not seem to do anything. I did discover the utility function that could be useful, but it will require that I manually install the database first (I think).
util/addons install phpmailer

Beni Grind

Sat, 10 Nov 2018 22:14:28 +0000

I'm using ssmtp as a sendmail replacement to send out mail. I'm sure it can be installed in a docker container.

Andrew

Sat, 10 Nov 2018 23:01:06 +0000

ssmtp looks like a way simpler option than the rabbit hole I fell down.

Beni Grind

Sun, 11 Nov 2018 08:45:17 +0000

Hope you manage to climb back up.. ;)

Königsberg, Russia, Fri, 09 Nov 2018 20:19:57 +0000 last edited: Fri, 09 Nov 2018 21:28:01 +0000

!!Hubzilla Development

And last (I hope so) step in image caching implementation in Hubzilla core.
Now we are send to clients and process obtained from remote systems images modification dates so its right time to start store this data in a hub storage. This will allow us to send a correct image modification date to clients which will be match to data received from remote systems.

Testing procedure

Click to open/close

root@zotum:/usr/local/www/zotum.net # cat hz.log | grep "import_xchan_photo:"
...
2018-11-09T21:21:43Z:LOG_INFO:5f8a8a1256:photo_driver.php:598:import_xchan_photo: import_xchan_photo: updating channel photo from https://framasphere.org/uploads/images/thumb_large_db8f7db2e073140a7c9b.jpeg for christguerm@framasphere.org
2018-11-09T21:21:43Z:LOG_INFO:5f8a8a1256:photo_driver.php:728:import_xchan_photo: HTTP code: 200; modified: 2018-11-06 17:43:05; failure: no; URL: https://zotum.net/photo/39cbe77ce716f1980d7b863eba55e517-4
root@zotum:/usr/local/www/zotum.net # curl -IL https://framasphere.org/uploads/images/thumb_large_db8f7db2e073140a7c9b.jpeg
HTTP/2 200
server: nginx/1.10.3
date: Fri, 09 Nov 2018 21:24:31 GMT
content-type: image/jpeg
content-length: 45735
last-modified: Tue, 06 Nov 2018 17:43:05 GMT
etag: "5be1d2a9-b2a7"
expires: Sat, 10 Nov 2018 21:24:31 GMT
cache-control: max-age=86400
accept-ranges: bytes

root@zotum:/usr/local/www/zotum.net # curl -IL https://zotum.net/photo/39cbe77ce716f1980d7b863eba55e517-4
HTTP/2 200
server: h2o/2.2.5
date: Fri, 09 Nov 2018 21:24:44 GMT
strict-transport-security: max-age=15768000; includeSubDomains; preload
public-key-pins: pin-sha256="WItA+7Wxv2l+HTFKvTrbx044AZcgaoufbqGy3o8aY28="; pin-sha256="dlwkJWkobXv9tML/jO5/81JrLcZIEH2R5t/FJSYp/HE="; max-age=2592000; includeSubDomains
x-powered-by: PHP/7.2.11
set-cookie: PHPSESSID=771f4ba47f6786e515ed2584d7501a41; path=/; secure; HttpOnly
content-type: image/jpeg
expires: Sat, 10 Nov 2018 21:24:44 GMT
cache-control: max-age=86400
last-modified: Tue, 06 Nov 2018 17:43:05 GMT
content-length: 24542

Preserve received image modification date on caching (!1386) · Merge Requests · hubzilla / core

Andrew

Fri, 09 Nov 2018 12:52:48 +0000

I finally succeeded in deploying a hub using Traefik and docker-compose. Traefik acts as a reverse proxy and automatically obtains and installs LetsEncrypt SSL certificates for you. Ideally this will allow people to deploy a hub with almost a single command. It would allow the Hubzilla developers to maintain the system dependencies and things like database optimizations. There are still some things to work out, including the cron job and the DNS issue with the database container address (merge request submitted).

show all 9 Comments

mrjive

Fri, 09 Nov 2018 13:57:21 +0000 last edited: Sat, 10 Nov 2018 14:15:43 +0000

Actually I was wondering where were you... Now I know the answer

BOET

Fri, 09 Nov 2018 20:46:10 +0000

Phewww... I believe this can be BIG!

Herbert Thielen

Fri, 09 Nov 2018 21:08:17 +0000

Sounds great!

Anmol Sharma

Fri, 09 Nov 2018 23:37:08 +0000

Hello,

For the followers of #docker, here are 3 new #Yunohost 3.2 images for AMD64, I386 ARM from #domainelibre: #Hubzilla , #osada #zap can be installed on Yunohost with #LDAP support which have #LetsEncrypt too.

https://hub.docker.com/r/domainelibre/yunohost3/

https://hub.docker.com/r/domainelibre/yunohost3-i386/

https://hub.docker.com/r/domainelibre/yunohost3-arm/

Have a good day !

Andrew

Sat, 10 Nov 2018 00:53:47 +0000

Thanks for the links. I didn't know YunoHost had Docker deployment now. It is a bit surprising, since YunoHost is itself serving a similar purpose to Docker. It's not a perfect analogy, obviously, but I think of YunoHost more like a Linux distro that you run in order to make installing and maintaining self-hosted web services easy through a web browser GUI. Software is infinitely permutable I suppose. If it makes things better for some people, I'm glad there is the option.

One thing I like about this docker-compose approach using Traefik is that it is straightforward to run the Hubzilla container and its coupled database container without the Traefik reverse proxy if you want to handle the web server component some other way. It's trivial to maintain two deployment methods this way since they are so closely related, and it provides more options for hub operators who have different needs.

Anmol Sharma

Sat, 10 Nov 2018 02:26:15 +0000

I get your point:

YunoHost is itself serving a similar purpose to Docker

There is an app to run #docker inside #yunohost . And another app which runs #yunohost inside #yunohost but I don't know what purpose it Serve. #Docker is really nice to run apps as it has become a web app deployment standard and every app gives/aims to provide support for #docker.

Andrew

Tue, 13 Nov 2018 20:35:07 +0000

Still working on this thing. The primary challenge is the fact that we have these DNS checks that fail from the docker container for some reason, but I can't bypass them using the existing Hubzilla config settings because those can only be added to .htconfig.php prior to database creation. But, if .htconfig.php exists, the hub setup is skipped because it assumes the database has been installed. My solution is to hack around this by installing the database schema via shell script when the container is initally started (if it does not already exist), and to generate the .htconfig.php in the Dockerfile, substituting or generating the relevant info. This should allow the admin to just immediately to the registration step based on the admin email they specified in the docker-compose parameters.

Tue, 13 Nov 2018 22:34:28 +0000

This is why there is .htpreconfig.php

Andrew

Wed, 14 Nov 2018 11:40:25 +0000

That doesn't help the DNS check that fails when you do the admin account registration. At that point, the database has been installed and a new .htconfig.php generated. The only way you can add the config to disable DNS check after the web-based setup process is by modifying the Hubzilla code which I didn't want to do.

New MR

Mario Vavti

Fri, 09 Nov 2018 10:02:21 +0000

further improve AP addressing to make pleroma happy (!159) · Merge Requests · hubzilla / addons

Basically address restricted messages to "cc" instead of "to". Only mentioned contacts will land in "to". If there are no mentions provide an empty "to" field otherwise pleroma will not accept the message.
This behavior also still works in mastodon.

!!Hubzilla Development

Anmol Sharma

Fri, 09 Nov 2018 23:49:12 +0000

Log to syslog

Mario Vavti

Fri, 09 Nov 2018 09:48:52 +0000 last edited: Sun, 11 Nov 2018 12:14:31 +0000

Since i have accidentaly pushed this directly to dev yesterday some might have not noticed this commit.

I find it handy sometimes for debuging to see logs in syslog (via journalctl -f). Hence i created the function hz_syslog() to accomplish this.

https://framagit.org/hubzilla/core/commit/302f49baf2acc23e6ea5da9778eeb18ad97c444c

!!Hubzilla Development

OT: framagit contact?

Jens (public)

Fri, 09 Nov 2018 08:45:16 +0000

hi !Hubzilla Development people, sorry for this off-topic post but I'm at a dead end with creating a framagit account and wonder whow you all managed this?

I created an account there and never received the confirmation email.
But the account is there and the given address is valid: I can, for example, do a password reset: I get an email from framagit and can follow the link and update my account password.
But I cannot log in: "Sorry the account needs to be verified first" - But how???

Also, the https://contact.framasoft.org/ is not helpful either, all french, everything leads nowhere. I tried Mastodon: no response on my contact, I went to twitter: "no spport, please use the website" and I don't understand anything else on that site.

Anybody have any idea on how to get this fixed?

Yea, I could simply create another account but that feels wrong.

show all 12 Comments

neue medienordnung plus

Fri, 09 Nov 2018 12:15:04 +0000 last edited: Fri, 09 Nov 2018 12:17:38 +0000

Have you tested with new Firefox Profil btw. with other browser? Maybe you have one Github account for logging in to https://framagit.org ?

Giacomino

Sat, 10 Nov 2018 02:54:53 +0000

I created an account there and never received the confirmation email. but
I can, for example, do a password reset: I get an email from framagit and can follow the link and update my account password.

.. very strange
I did not have this problem...

neue medienordnung plus

Sat, 10 Nov 2018 04:23:53 +0000

I created an account there and never received the confirmation email.

I suggest to test with #EMail from other #eMailProvider .

Jens (public)

Tue, 13 Nov 2018 09:25:15 +0000

thanks guys, although my hope was more in the direction of "oh, just contact xyz@framagit.org and ask for the confirmation email to be re-send"

neue medienordnung plus

Tue, 13 Nov 2018 09:29:00 +0000

@Jens (public) , have you solved the #confirmproblem ?

neue medienordnung plus

Tue, 13 Nov 2018 09:31:10 +0000

@Jens (public) You did not reply my questions - see above.

Jens (public)

Tue, 13 Nov 2018 09:36:26 +0000

@neue medienordnung plus no. As explained initially, it seems impossible to contact somebody there to get actual help. So I will have to try again from scratch, create another account using a different email address.

Jens (public)

Tue, 13 Nov 2018 09:49:40 +0000

@neue medienordnung plus your comments came in in the wrong order and with a delay. As to "You did not reply my questions - see above"

The account got created. That much seems obvious as my login credentials are accepted (but the account is not "activated") and the given email address is valid (I can request a password reset and will receive the email accordingly).

Different browser wold not help. Logging in via Gitlab, Github doesn't work because for that I need to have an active framagit account first! Dead end as well.

Herbert Thielen

Tue, 13 Nov 2018 11:23:11 +0000

I'd try to use https://contact.framasoft.org/

select "J'ai besoin d'aide" (I need help)
then select "FramaGit"
then fill in the contact form (name, email, subject, and problem)

I guess they will understand english

hEARt PhoniX

Tue, 13 Nov 2018 11:44:07 +0000

They are French.
Don't assume.
^^

Herbert Thielen

Tue, 13 Nov 2018 11:45:55 +0000

They are french open source coders, hey.

Jens (public)

Tue, 13 Nov 2018 11:58:17 +0000

Thanks @Herbert Thielen for the suggestion! There is indeed a form hidden behind that, wow! Will try that now

Königsberg, Russia, Thu, 08 Nov 2018 17:08:13 +0000 last edited: Thu, 08 Nov 2018 18:03:17 +0000

!!Hubzilla Development

As far we have advanced image caching support in Hubzilla server part now it is the time to implement consistent cache storage with exact modification date for each stored object.
For the first and most important step, I suggest changing the import_xchan_photo function, adding support for the HTTP header “Last-Modified” and “304 Not Modified” to be able to return a correct image change datetime.
I modified the specified function in way to do not violate compatibility with the current Hubzilla code.
Two parameters have been added - optional function input parameter (force to igore modification date and 304 code) and image modification datetime as last item in returned array element [5].
With this we can store a real image modification data in photos and xchan tables.

Return image modification date on remote fetch for caching (!1383) · Merge Requests · hubzilla / core

Königsberg, Russia, Wed, 07 Nov 2018 12:39:45 +0000 last edited: Wed, 07 Nov 2018 13:22:42 +0000

!!Hubzilla Development

In continuation to previous merge I added If-Modified-Since HTTP header support in Hubzilla image processing module. Because we have Last-Modified (added yesterday) and we can get a complete image caching support implementation at server side.

Testing procedure

Click to open/close

Profile photo

root@beta:~ # curl -IL 'https://zotum.net/photo/profile/l/11?rev=2018-07-25+09%3A04%3A01'
HTTP/2 200
server: h2o/2.2.5
date: Wed, 07 Nov 2018 12:37:35 GMT
strict-transport-security: max-age=15768000; includeSubDomains; preload
public-key-pins: pin-sha256="WItA+7Wxv2l+HTFKvTrbx044AZcgaoufbqGy3o8aY28="; pin-sha256="dlwkJWkobXv9tML/jO5/81JrLcZIEH2R5t/FJSYp/HE="; max-age=2592000; includeSubDomains
x-powered-by: PHP/7.2.11
set-cookie: PHPSESSID=8aa91faa19ee0bbd12c83d38e3218c06; path=/; secure; HttpOnly
content-type: image/jpeg
expires: Thu, 08 Nov 2018 12:37:35 GMT
cache-control: max-age=86400
last-modified: Wed, 26 Sep 2018 18:59:26 GMT
content-length: 104495

root@beta:~ # curl -IL --header 'If-Modified-Since: Wed, 26 Sep 2018 18:59:26 GMT' 'https://zotum.net/photo/profile/l/11?rev=2018-07-25+09%3A04%3A01'
HTTP/2 304
server: h2o/2.2.5
date: Wed, 07 Nov 2018 12:37:45 GMT
strict-transport-security: max-age=15768000; includeSubDomains; preload
public-key-pins: pin-sha256="WItA+7Wxv2l+HTFKvTrbx044AZcgaoufbqGy3o8aY28="; pin-sha256="dlwkJWkobXv9tML/jO5/81JrLcZIEH2R5t/FJSYp/HE="; max-age=2592000; includeSubDomains
x-powered-by: PHP/7.2.11

For photos

root@beta:~ # curl -IL 'https://zotum.net/photo/75fab92618f9a897a245488425be2bf60bcd8ff101f08d5242f05bf44ef24b8d-2.jpg'
HTTP/2 200
server: h2o/2.2.5
date: Wed, 07 Nov 2018 12:38:54 GMT
strict-transport-security: max-age=15768000; includeSubDomains; preload
public-key-pins: pin-sha256="WItA+7Wxv2l+HTFKvTrbx044AZcgaoufbqGy3o8aY28="; pin-sha256="dlwkJWkobXv9tML/jO5/81JrLcZIEH2R5t/FJSYp/HE="; max-age=2592000; includeSubDomains
x-powered-by: PHP/7.2.11
set-cookie: PHPSESSID=bcdba9d6744cb4db6d02f300b29fad80; path=/; secure; HttpOnly
content-type: image/jpeg
expires: Thu, 08 Nov 2018 12:38:54 GMT
cache-control: max-age=86400
last-modified: Fri, 02 Nov 2018 07:04:44 GMT
content-length: 124980

root@beta:~ # curl -IL --header 'If-Modified-Since: Fri, 02 Nov 2018 07:04:44 GMT' 'https://zotum.net/photo/75fab92618f9a897a245488425be2bf60bcd8ff101f08d5242f05bf44ef24b8d-2.jpg'
HTTP/2 304
server: h2o/2.2.5
date: Wed, 07 Nov 2018 12:39:10 GMT
strict-transport-security: max-age=15768000; includeSubDomains; preload
public-key-pins: pin-sha256="WItA+7Wxv2l+HTFKvTrbx044AZcgaoufbqGy3o8aY28="; pin-sha256="dlwkJWkobXv9tML/jO5/81JrLcZIEH2R5t/FJSYp/HE="; max-age=2592000; includeSubDomains
x-powered-by: PHP/7.2.11

Added `If-Modified-Since` header support for better image caching and fixed absent 404 for photos (!1374) · Merge Requests · hubzilla / core

show all 15 Comments

Wed, 07 Nov 2018 12:58:47 +0000

I'll take a look. I need to look again at the changes from Yesterday now that my brain has had a bit more sleep. I have one of those nagging, uncomfortable questions that I need to figure out about this.

Wed, 07 Nov 2018 13:24:03 +0000

@M. Dent I'm always opened for constructive criticism and ready to move forward together.

Wed, 07 Nov 2018 13:33:26 +0000

After we will got caching support at Hubzilla in server role I have plans to implement image smart caching for Hubzilla as client on the same principles.

Wed, 07 Nov 2018 14:11:46 +0000

OK, my fears are allayed. My concern was that yesterday's changes didn't just modify existing cache mechanisms, but actually ADDED cache mechanisms where they didn't exist - and I was worried about private data leakage.

I half remember checking before I merged but my brain didn't completely register that I had thought about it and "cleared" the concern as I was thinking about it again this morning.

So, basically, before we ended up going too far down a path of caching support where it could result in private data leakage, I wanted to hit take the time to be sure we were on the right path.

(Of course, we can't control for everything (broken browser cache implementations, bad actors "snooping" on end user machines, whatever) - If we CAN mitigate some of those things, it's a good idea to look at doing so. But making sure what we do doesn't leave things accessible that should be private (assuming all the advertised mechanisms are working properly) is the baseline I'm looking at.)

Wed, 07 Nov 2018 14:16:59 +0000 last edited: Wed, 07 Nov 2018 14:19:18 +0000

So, basically, before we ended up going too far down a path of caching support where it could result in private data leakage, I wanted to hit take the time to be sure we were on the right path.

In this part nothing was changed in code.
I played a little with permissions on images while tested code today and found that current logic is works.
But more deep testing will be usefull to be sure.

Mario Vavti

Thu, 08 Nov 2018 10:10:22 +0000

After recent changes in mod photo the download of the original size photos was broken due to wrong content-length header size.
I submitted a fix: https://framagit.org/hubzilla/core/merge_requests/1379

Thu, 08 Nov 2018 10:43:54 +0000

I saw this earlier and notified Max that it could cause issues, so thanks.

Thu, 08 Nov 2018 10:46:09 +0000

Merged. Thanks Mario.

Thu, 08 Nov 2018 10:54:42 +0000 last edited: Thu, 08 Nov 2018 10:56:49 +0000

This will not work in case if this was a profile photo so we need to give $filesize a value based on $data.
Added MR to your repo
Correct "Content-Length:" calculation added (!1) · Merge Requests · Mario / core

Mario Vavti

Thu, 08 Nov 2018 10:57:08 +0000

I think that is redundant. The filesize is saved for all sizes in the DB iirc...

Thu, 08 Nov 2018 11:01:47 +0000 last edited: Thu, 08 Nov 2018 11:03:59 +0000

Perhaps but in current code $filesize variable will get value only in case if it was a other (not profile) photo.
Please check if I'm wrong.

Mario Vavti

Thu, 08 Nov 2018 11:12:47 +0000

Ah... I missed the profile photo section...
You are right!

Mario Vavti

Thu, 08 Nov 2018 11:17:55 +0000

https://framagit.org/hubzilla/core/merge_requests/1382

Thu, 08 Nov 2018 11:26:14 +0000

Great! Please merge it ASAP ( @M. Dent ? )

Thu, 08 Nov 2018 12:10:15 +0000

Merged

Zotlabs|Hubzilla Development

hubzilla-development@zotlabs.org