0

I'm new to microservices, so trying to do a little app.

This is my current design:

Create two LambdaServices: 

1) GetSomeData (string domainName, string nextSNS, ILambdaContext context) 
2) StoreSomeData (string jsonData)

Part 1:

My understanding of microservice is that each function should do only one thing. So "GetSomeData" takes a domain name, does a web call, parses the results into JSON. Then I need to store it in an RDS database in StoreSomeData. But in the future, I might want to just get the data, or do something else with it.

The function I need 99% of the time now, is really GetAndStoreSomeData. But if I do that, I'm not a microservice, right?

So I'm thinking if a program just wants the JSON back from "GetSomeData", it will just pass null in the nextSNS. But if it wants to store the data, it will pass an SNSTopicName or arn in nextSNS, then "GetSomeData" will publish a message to that SNS with the JSON response.

The process will be kicked off by some other process that I haven't totally figured out yet, that will pick some domains from the RDS database, and probably call API-Gateway to launch "GetSomeData". I'll probably have to run it from some type of scheduler.

I'd like to know if this is a good design. I just got "GetSomeData" published and tested without the "nextSNS" parm.

Part 2:

If "GetSomeData" needs to publish to SNS, how can I do that without storing the IAM credentials. Can I use a role? Or I have to use the secret access key, which maybe I could put in an environment variable to at least keep it out of the code.

I was thinking of cloning this method: https://gist.github.com/bkizzy/2705156 to publish the SNS message. But then I found a Java sample that is only about 6 lines of code for the call here: Lambda does not trigger SNS event. Chaining AWS lambdas with SNS. Is there similar short way to do the same from C#? I couldn't find much on the Amazon site on how to publish SNS other than the raw request/response. (https://docs.aws.amazon.com/sns/latest/api/API_Publish.html)

Improve this question
0

2 Answers 2

Reset to default
2

Pretty much by definition any answers you get here will be a bit opinionated but...

Part 1

"Microservice" is a very nice marketing name but ultimately it is a design pattern, not a hard and fast design rule. To me alot of it depends on the support structure around the services. For example, I work mostly in startup environments. That means I have to handle the AWS RDS, AWS VPC, AWS EC2 with the AWS ELB, and so on with the TLA's.

Other environments have dedicated DevOps people that are there to assist in managing the environments.

That's a long way of saying that if you want to only maintain a single Lambda then maintain a single Lambda. The Microservice police may or may not accost you but only you know what makes the most sense in this area.

Part 2

One of the cool things about AWS Lambda's (and EC2 has a very similar concept) is that you can set up an execution role. Basically what this is is a role in IAM that your Lambda code runs under. So if, for example, your Lambda needs to send an SNS message, you can add AmazonSNSFullAccess to the role that is running the Lambda and your Lambda can now send and receive SNS messages.

In terms of getting the credentials for the C# environment, it looks like this blog post gives you an idea of how to do it.

I'll admit that I'm not familiar with the C# side of things to send SNS messages but it looks like Publish maps well to the Java side of things.

Improve this answer
Sign up to request clarification or add additional context in comments.

5 Comments

Okay, thanks on the role. I did have a role, but didn't think about how to give it SNS. Still trying to figure out how to code/reference the PublishRequest (see comment to @markb). For the microservice, I'm just experimenting with what it would be like to be a purist. It make sense for CI/CD, testing, rapid deploys, with minimal collateral damage etc...
On the microservice side - totally agree. Again, in my mind it all depends on the support structure you have around you. If you're one of two engineers on a team you may not have all of the support structure. But a full team will have that. On the publish side, I found this link (scroll past the HTML pasted code) for what looks like a pretty simple chunk of code.
Thanks, I think I found that same page, once I started looking for C# and PublishRequest. But I can't find the right "using" statement to reference it in Lambda/Core.
Trying this now: Install-Package AWSSDK.SimpleNotificationService -Version 3.3.0.23
Started new specific question for the publish SDK. stackoverflow.com/questions/46979765/…
1

The answer to your specific security question is that you assign an IAM execution role to each Lambda function which allows it to access things like SNS. You don't use credentials like AWS secret access key with your Lambda function.

Regarding the difference in Java and C# interactions with AWS, the C# method you linked for posting to SNS is using raw HTTP connections instead of using the AWS SDK for .NET, so of course it's way more lines of code. You should definitely use the official AWS SDK, which will make your C# code look almost identical to the Java code you linked.

Improve this answer

4 Comments

I just used "Install-Package AWSSDK.Core -Version 3.3.18.2" to add the SDK Core, but I cannot figure how what using statement(s) to use for PublishRequest or AWSClientFactory. Any ideas?
I finally found c# example here: docs.aws.amazon.com/sdkfornet/latest/apidocs/items/… (2.0 of SDK). The 3.0 of SDK seems to have some bad links in Google and searching says "try later". So I don't think the 2.0 is for Core, and they don't show the using statements.
Trying this now: Install-Package AWSSDK.SimpleNotificationService -Version 3.3.0.23
Started new specific question for the publish SDK. stackoverflow.com/questions/46979765/…

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.